NASA-CR-195695 


3?° 

mP 

LjSjo 71 


%0 


>o 


00 


r- 

l/t 

rg 

fl3 

1 



u 

o 

c 

z 

r> 



o 

o 


CD 

N 

m 

o 


DRMATION SCIENCf b lidk# 
AMES RESEARCH CENTER 
MOFFETT FIELD, CALIF. 

JUL 211392 


Z 

= Q «- ■- 

: •-» fU •— 

»- C 0) 
— < '» ? 
X LL ^ 

o v 

H- -J O 


o 

SO 


tu oc 

< o ^ • 

o a 

s: w 

^ ♦> o 

lA h W y 
a CO O 
\Q O CL*-* 
ir u 0) TO 
o a: c 
H O 


| -J — 

U O 

u > o a? 



to ,C $ 

<11 

ZhDC 

w H* *""* 




Rockwell International 
Space Systems Division 
12214 Lakewood Boulevard 
Downey, CA 90241 




Final Technical Report 


Automation Life-cycle Cost Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


Table of Contents 


Prologue 1 

1. Introduction 

2 Problem Statement 

Z1 Designing The Optimal Mix Of Automated And ManuaUy Operated Systems 2 

22 Limitations of Cost Estimating Tools ’ 

23 Decision Analysis “ 7 

24 Problem Summary 7 

3. Objectives 

3.1 Far-term Objectives 

3.1.1 General Requirements 

3.1 .1 .1 General Capabilities 

3.1. 1.2 Comparative Analysis 

3.1.13 Output/Display Formats ^ 

3Z Near-term Objectives ^ 

4. Approach 17 

42 Existing Model Identification * 

43 Existing Data Source Identification 

4.4 Advanced Technology Impact Determination 

4.4.1 Assessment of Technology Drivers and Technology Readiness Levels for Robotic ^ 

Systems _ n 

4.4.1 .1 Mobile Base Platform TT 

4.4.1 .2 Manipulator Subsystems 

4.4.13 Special Tools/End-effectors 23 

4.4.1 .4 Rockwell Space Systems Division Involvement in Robotics and Related 

Technologies 2 * 

4.4.1 .5 Identification of Existing LCC Methodologies “ 

43 Decision Modelling System (DEMOS) Tool Capabilities " 

5. Automation Life-cycle Cost Model (ALCM) 

5.1 Overview * M 

52 System Architecture Definition 

52.1 Generic Life-cycle Cost Categories • " 

52.1.1 Research and Development (R&D) Phase Cost Categories 

5.Z12 Investment and Acquisition G&A) Phase Cost Categories 

52.1.3 Operation and Support (O&S) Phase Cost Categories 32 

522 Specific Cost Categories 

53 Model Development 

53.1 Background 3g 

53.2 Approach y:* ” 

53.3 Development of Cost Estimating Rationale For Robotic Systems/Subsystems 38 

5.4. Framework Prototype ^ 

5.4.1 Framework Overview ^ 

5.4.2 Major Components 

5.4. Z1 Phase Definitions 


Rockwell International Space Systems Division 


Page i 



Final Technical Report 


Automation Life-cycle Cost Model (ALCM) 
NASA Ames Research Center 
Contract #:NAS2-13419 








54.2.2 Rate Breakdown 

542.3 Program-specific WBSs 

5 4.2.4 Cost Analysis Features •••••■;■ 

54 2.5 Automation Bottom-line Analysis 

5 4.2.6 Software Cost Modelling 

542.6.1 Autotrade Overview 

5.42.62 COCOMO Cost Drivers 

5.4.2.63 Size and Productivity 

5.42.6.4 Autonomy Levels Definition 

54.2.6.5 CSCI Identification 

5.42.6.6 Summary Analysis 

5.42.6.7 Autotrade Summary.— 

5.4.3 Framework Capabilities Summary 

6. Model Validation 

6.1 Overview 

62 Sample Scenario ••••••• 

7. Comments and Conclusions. 

7.1 Suggested Improvements to the 

72 Follow-on ALCM Effort Statement o 

8. References *"’ 

92 Technical Interchange Meeting (JIM) #2 Notes 

93 ALCM Tool User Notes 

93 Criteria for Robotics CER Generation 

9.6 Robotics DDT&E CER Tables 






50 

51 

55 

55 

56 

57 

59 

59 

61 

62 

64 

65 

65 

66 

66 

67 

67 

69 

72 

78 

79 


Rockwell International Space Systems Division 


Page ii 



Final Technical Report 


Automation Life-cycle Cost Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


List of Figures 


Figure 1. The ALCM Tool is the Result of Cooperative Determination of Envisioned 

Capabilities Between NASA and Rockwell ■; ■■■■" 7” 

Figure 2. Near-term Objectives are an Achievable Subset of the Envisioned Capabilities of 

the Final ALCM Tool '^ 7- 17 xVTi 

Figure 3. Program Life-cycle Phases and Functions for Space Systems Defme the Modules for 

the ALCM Tool 

Figure 4. Life-cycle Cost Methodology How Interfaces With All Aspects of a Program 26 

Figure 5. ALCM Life-cycle Phase Definitions 

Figure 6. Sample ALCM Work Breakdown by Life-cycle Cost Phase. 

Figure 7. The ALCM Approach Capitalizes Upon a Large, Known Body of Pertinent Data, 

Advanced Robotic Applications, and Standardized Costing Methods to Address 

the Entire Life-cycle Cost for Space Systems ~6 

Figure 8. Reach-related Costs Rise Quickly Over 40 Feet 41 

Figure 9. Payload Capability Cost is Very Dependent Upon Weight Until Around 200 ^ 

Pounds 

Figure 10. Cost Associated with Positioning Accuracy Rises Dramatically with Requirements 

Less than 0.1 Inch 

Figure 11. Near-term Objectives are an Achievable Subset of the Envisioned Capabilities of 

the Final ALCM Tool 

Figure 12. Influence Diagrams Are Used to Construct Sophisticated Models in a Readily ^ 

Understandable Format 

Figure 13. The Top Level of the Prototype Contains the Major Model Components for L-ase^ 

of Use and Navigation. •• V*.Tt*nT* w 

Figure 14. The Research and Development Cost Categories are Implemented as a List Which 

is Capable of Being Edited 7.’7‘"7‘7"" 

Figure 15. Investment and Acquisition Costs Include Non-recurring Elements Which Can ^ 

Be Tailored Per Project 49 

Figure 16. Operation and Support Costs Typically Account for the Bulk of Life-cycle Cost aim 

Can Be Reviewed in Detail 50 

Figure 17. Time-dependent Factors of Cost are Modelled Through the Rate Breakdown 

Submodel •; 

Figure 18. The ALCM Framework Supports Multiple Cost Estimation Methodologies and ^ 

Their Comparative Analysis ; 

Figure 19. Different Estimation Methodologies Are Applied to Appropriate Costing ^ 

Situations 

Figure 20. The ALCM Framework Prototype Provides a Flexible Environment for 

Constructing and Reviewing Space System Cost Models Based on Work ^ 

Breakdown Structures 

Figure 21. ALCM Framework Provides Cost Analysis Capabilities to Review Cost by Phase 

^ and Element to Determine Key Drivers in the Life-cycle. •;•••; 55 

Figure 22. The Bottom-line Figure is Available From the Model Without Examining an ^ 

Immense Amount of Detail ...................... 

Figure 23. Autotrade is Functionally Partitioned to Ease Navigation of the Model 58 


Rockwell International Space Systems Division 


Page Hi 




Final Technical Report 


Automation Life-cycle Cost Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


Figure 24. Autotrade Automatically Assigns the Correct Numeric Value to Each COCOMO 

Cost Driver to Provide Consistency 59 

Figure 25. Autotrade Permits Uncertain Size Estimates for Each CSCI to be Used for 

Derivation of Productivity Parameters 

Figure 26. CSCI Productivity Measures May Be Analyzed From Several Perspectives. 61 

Figure 27. Specification of Autonomy Level per CSCI Supports Software Cost/Benefit 

Analysis for Space Systems 62 

Figure 28. Cost Driver Values Are Specified For Each CSCI Permitting Detailed Analysis of 

the Envisioned System 63 

Figure 29. COCOMO Cost Factors May be Examined With Their Assigned Values per 

Autonomy Level and In Rank Order to Obtain Their Relative Importance 64 

Figure 30. Summary Trade-off Analysis is Supported by Presenting Costs and Productivity 

Measures Over a Range of Autonomy Levels 65 

Figure 31. Sample ALCM Object Definition Window With Provisions For System 

Descriptions and Data Legacy /Fidelity •— 70 

Figure 32. Parametric vs. Accounting Methods For Determining TFU Costs For The Various 

Elements of A Sample Robotic System.— 71 

Figure 33. ALCM Model Will Perform Simultaneous Bottom-Up and Top-Down Cost 

Analysis and Assess Validity of Parametric Relationships 72 


Rockwell International Space Systems Division 


Page iv 




Final Technical Report 


Automation Life-cycle Cost Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 

Table 


List of Tables 

1. Summary of AT AC Automation and Robotics Findings 1 

2. A&R Applications Can Especially Benefit the Operation and Maintenance of a Space 

System ^ 

3. Previous Productivity Improvement Results Have Been Qualitative 3 

4. Problems with Traditional Software Tools for Modelling 6 

5. Far Term ALCM Capabilities Will Support Management Decisions And Ensure 

Low LCC With Identified Uncertainty 8 

6. The Approach Ensures an Interim Product to Assist Tool Acceptance and Validity.13 

7. Utilizing Three Different Analysis Perspectives Provides the Opportunity for a 

More Robust and Useful ALCM Tool •••• 

8. Existing Models Are Leveraged to Accelerate the Pace of ALCM Tool Demonstration 

and Development 18 

9. Use of NASA Technology Readiness Levels Can Facilitate Risk and Development 

Cost Generation " 

10. Summary Findings of Data Sources Reviewed W 

11. DEMOS is a Highly Flexible and Appropriate Environment for the Solution of LCC 

Problems — * 

12. DEMOS Features Can Be Easily Tailored for the ALCM Tool 25 

13. Research and Development Phase Cost Category Definitions 30 

14 Investment and Acquisition Phase Cost Category Definitions 31 

15. Operation and Support Cost Category Phase Definitions 32 

16 Spreadsheet Analysis of Mobile Base Platforms To Determine Calibration 

Coefficients 88 

17. CER Generation is Highly Reliant Upon Experienced Personnel and Mathematical 

Expression Manipulation Tools ^9 

18. Spreadsheet Analysis of Manipulator Systems To Determine Calibration 

Coefficients 

19. The Manipulator System CER Uses all Associated Major Design Parameters 40 

20. The ALCM Framework Prototype Has Met the Program's Objectives 66 

21. The ALCM Framework Examines the Entire System Life-cycle to Maximize Cost 

Savings Potential 88 


Rockwell International Space Systems Division 


Page v 




Final Technical Report 


Automation Life-cycle Cost Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


List of Acronyms 


\ 


A&R 

AIAA 

ALCM 

ATAC 

CER 

COCOMO 

csa 

DDT&E 

DEMOS 

DoD 

DOT 

DTLCC 

GE 

GUI 

HART 

I&A 

IOC 

IR&D 

LOC 

LRU 

MMI 

NASA 

O&S 

OPF 

ORLA 

PEP 

PLANET 

PLS 

PRAF 

R&D 

RPAL 

RSOC 

SEI 

SLOC 

SOW 

SSD 

TFU 

TIM 

U.S. 

WBS 


Automation and Robotics 

American Institute of Aeronautics and Astronautics 

Automation Life-cycle Cost Model 

Advanced Technology Advisory Committee 

Cost Estimating Relationship 

Constructive Cost Model 

Computer Software Configuration Item 

Design, Development, Test, and Evaluation 

Decision Modelling System 

Department of Defense 

degree of freedom 

Design To Life-Cycle Cost 

General Electric 

Graphical User Interface 

Humans/ Automation/Robotics/Telerobotics 

Investment and Acquisition 

Initial Operating (Operational) Capability 

Independent Research and Development 

Life-Cycle Cost 

Line Replaceable Unit 

Man/machine interface 

National Aeronautics and Space Administration 

Operations and Support 

Orbiter Processing Facility 

Optimum Repair Level Analysis 

Produdbility Engineering and Planning 

Planetary Logistics Analysis and Evaluation Tool 

Personnel Launch System 

Production Rate Adjustment Factors 

Research and Development 

Rockwell Palo Alto Laboratory 

Rockwell Shuttle Operations Company 

Space Exploration Initiative 

Source Line of Code 

Statement of Work 

Space Systems Division (Rockwell International) 
Theoretical First Unit 
Technical Interchange Meeting 
United States 

Work Breakdown Structure 





Rockwell International Space Systems Division 


Page vi 



Final Technical Report 


Automation Life-cycle Coat Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 



Prologue 

This report is submitted to satisfy the contractual requirement of a final technical report. Its 
purpose is to provide concrete evidence of proper progress on this contract. AU 
information, data, and models created during this effort are 

This document is structured to coincide with the Statement of Work (SOW) for this 
contract. Section 7 (Comments and Conclusions) consists of an overview of the satisfaction 
of the SOW tasks. Additionally, recommendations for the future direction and capabilities o 
the Automation Life-cycle Cost Model (ALCM) are noted. Appendices include additional 
information on Technical Interchange Meeting (TIM) charts, programmatic information, 
and Decision Modelling System (DEMOS) reference material. 


1. Introduction 

The United States Congress mandated, in 1984, that the National Aeronautics and Space 
Administration (NASA) vigorously advance the arts of automation and robotics (A&R) as 
they apply to space programs. In addition, the NASA Administrator was tasked to establish 
an Advanced Technology Advisory Committee (AT AC) in conjunction with NASA s Space 
Station program. Among the activities performed by the ATAC, was the generation of a 
report that was intended to provide top level guidelines and requirements for effective 
implementation of A&R into space systems. Table 1 presents a summary of the preliminary 

ATAC findings.l2j 

• Criteria for the incorporation of A&R technology should be developed and promulgated. 

• Verification of the performance of automated equipment should be stressed, including terrestrial 

and space demonstrations to validate technology for Space Station use. 

• Maxi mum use should be made of technology developed for industry and government 

• The techniques of automation should be used to enhance NASA’s management capability. 

• An evolutionary station should achieve, in stages, a very high level of advanced automation. 

• An aggressive program of long-range technology advancement should be pursued, recognizing 

areas in which NASA must lead, provide leverage for, or exploit developments. .... 

• A vigorous program of technology transfer to US. industries and research communities should be . 

• NASAshould provide the measures and assessments to verify the inclusion of A&R in the Space 

Station . — 


Table 1. Summary of ATAC Automation and Robotics Findings. 

A recurring theme throughout the ATAC findings was the requirement for identification 
and development of management control parameters, corresponding to AkR 
design /development and implementation. The final item listed in Table 1 states a 
requirement to quantitatively trade-off various configurations using variations in the use 
of A&R in space systems. More specifically, measures of effectiveness criteria, assessment 
aids, and utility models were identified as methods to support management objectives and 
to accurately project future system capabilities and costs. The ATAC explicitly recommended 
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the development of life-cycle cost (LCC) models and methods for evaluating the Space 
Station program, as a method for projecting costs throughout the life of a program, and to 
ease management decisions and planning. 

In the context of this contract, the term automation applies to systems ranging from 
physical devices that mechanize a particular process to the application of knowledge-based 
systems. Robotic devices would range from tele-operated machines to fully autonomous 
vehicles, deployed either in space or on the ground (distant planet). While AAR definitions 
are germane to the development of an automation cost estimation/ analysis type model (to 
the degree that an LCC model would have to be sensitive to varying degrees of AAR 
technology), emphasis is not directed towards analysis of AAR technical properties, rather to 
how the varying degrees/levels effect overall program costs. 


2. Problem Statement 

Two analyses instrumental to the selection of automated versus manually operated systems 
are: (1) LCC analysis, and (2) comparative analysis. The results of these two types of analyses 
are subject to the limitations of the methods beings applied, and it is typically difficult to 
assess the accuracy /quality of the input or output data. 

2.1 Designing The Optimal Mix Of Automated And Manually Operated Systems 


A key issue in planning future space projects is deciding the appropriate level of AAR. In a 
specific program, such as the Space Exploration Initiative (SEI), we must decide which tasks 
are better performed by astronauts, and which by AAR. Table 2 presents a list of the issues 
and/or trades that must be addressed.[2] As AAR technology advances, how and when 
should those advances be applied to operational systems? The following parameters are 
critical: cost, technology maturity, complexity, maintainability, and reliability. Employing 
automation is not an either/or question, but one of degree. The question is what level of 
automation and autonomy will provide the optimal trade-off between performance and 
cost. 


• Life-cycle operations costs will overwhelm start-up costs. Later operational costs could restrict 

or terminate the program. 

• Costs of initial AAR hooks and scars affect life-cycle-cost (ICC) savings. 

• Automated systems may lower probability and costs of accidents. 

• The level of AAR leverages the value of astronaut time. 

• AAR can improve support and increase crew time for user payload. 

• Extra ground support may be needed for AAR technology and space robotics. 

• Space testing of AAR systems introduces new costs. 

• Extensive ground-based control may overload communications capacity. 

• Faster response time resulting from on-board data analysis will lower costs. (This can be 

substantial if an on-board expert system does trend analysis.) 

• Use of tele-operated, instead of autonomous, systems will raise cost of train ing astronauts. 

Table 2. A&R Applications Can Especially Benefit the Operation and Maintenance of a Space System. 
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n«» imnart of the deeree of A&R and human partidpation on a given program is 

being that a task analysis, along with addressing cost issues, also addresses system 
availability and maintenance concerns. 
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emerge as the leading system candidates. 
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2J2 Limitations of Cost Estimating Tools 

Developing cost estimates using automated or even manual methods and techniques is not 
new. In fact, there are just as many, if not more, models/tools as there are operational 
systems. There are potentially many reasons for this, however, one can intuitively conclude 
that new models and took arise because the previously existing capabilities contained some 
form of inadequacy. These inadequacies include: 


(1) The assumptions, structure, and limitations of cost models are not clearly 
documented. 

(2) The source, quality, uncertainty, and relevance of input data are not clearly 
documented. 

(3) The limitation and uncertainties in the output results are not clearly 
documented. 

(4) Cost models have been built to estimate the cost of a design after the design has 
been specified, rather than developed as an integral part of the design process to 
help with early design decisions. 

(5) Separate cost models are built for different project phases and subsystems, often 
using different assumptions, making it difficult to combine them to assess the 
full life-cycle cost for the system. 

(6) Cost models use only a single methodology, and do not support multiple 
approaches, such as top-down, parametric cost estimation, and bottom-up 
methods for cross-validation. 

Customers and contractors alike struggle with the limitations of current cost estimating 
tools. This is due primarily to the fact that a model's construction, assumptions and 
limitations are typically not well documented. Cost estimation models that address, equally, 
all components and phases of a program are rare. Therefore, the results will reflect the 
limitations of the model/tool. There are three principal reasons why cost estimating tools 
do not represent a "true" reflection of system life-cycle costs. 


(1) The nature of a model may not match the particular phase of a given program. 

For instance, accounting-type models (Le., PRICE) require detailed information to 
project system LCC, and their application during conceptual phases of a system 
would tend to skew results. Similarly, it would not be appropriate to employ 
parametric estimating tools or techniques to mature programs where sufficient 
data exists to populate an accounting model to support management assessment 
and projection requirements. 
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0 Modeb that are 'generic” in nature may not be suited to perform assessments on 
specific and complex systems/projects. 

Models tend to reflect the experience of their designers: models developed by 
° ^ vew toowfedgeable about system operational phases will tend to well 

represent^ recuning cost categories' and poorly treat the non-recurring cost 
categories; and those familiar with design, development and production wiU 
tencf to embellish models with those features, while treating recurring operatio 
and support costs as percentages of the non-recurring cost categories. 

toul d°n T“ 4 ‘O ascertain ib relevancy to the project under coiu.dera wn_ For 

E'nce esri^HSt production cost may be based on prior expenencerelatri ^st^lar 

^Ucfcted will the quality and relevance of input data on the accuracy of the resultan 
model output. 

When considering the limitations of a particular model and its input data, one 'ends to^ 
view the results with suspicion or outright skepticism. The situation b eMMtbated when a 
customer aurmot duplicate and therefore 6 validate the data. If some form of ** ib*«ment 
doe^accompany cos? data, it b usuaily at the cost of a sepata>e aivi "gorous modehng 
exercise, one that b fraught with ib own assumptions and limitations. 

Finaliv life-cvde cost assessmenb have been traditionally limited to projecting program 

eranularitv to determine exactly which elements of a system are dn g aW^to 

Slirrinffor total LCC To achieve an optimally low cost system, designers must be able to 

mnid and user friendly component trade studies and sensitivity analyses Second. 
components are designed. 
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23 Decision Analysis t j 

Implicit in the problems listed above, is the accuracy of the required model inputs. 

Projecting future costs, and future capabilities, is fraught with penl. A method must be 
encapsulated in the model to pr ovide rea listic assessme nt o f LCC outcomes. This method 
should allow for alternative options, explicit representation of system states and 
relationships, provide a means for model evolution, and account for the uncertainty of the 
problem domain. 

Real-world problems inherently contain partial data. Extrapolation and abstraction methods 
may be applied to remedy this situation so that the domains might be modelled. Modelling 
by its very nature requires abstraction of portions of the problem domain so that there is a 
tractable solution. Traditional modelling techniques typically embrace these abstractions 
wholeheartedly and weave them into the solution space. A more correct method is to 
explicitly account for those abstractions and model them directly. In this manner, 
confidence in the solution and insight into the problem domain are expanded. 

Recent progress in decision analysis theory and tools have made it practical for their 
application to real-world problems. "Probability and decision theory provide a set of 
principles for rational inference and decision making under uncertainty... Decision analysis 
is the art and science of applying these ideas to provide practical help for decision making in 
the real world."I3] Decision theory permits the explicit statement of preferences among 
alternate possibilities with associated levels of belief and resolves their combination within 
a consistent computational domain. Applying this theory permits sensitivity analyses to be 
conducted on a problem space so that key drivers to the ultimate solution may be readily 
identified. This capability permits the focusing of energy on those important parameters 
within the problem so that the uncertainty might be reduced. Hence, confidence increases 
in the ultimate solution of the problem model. 

Modelling cost, with its tools and environment, is typically a stumbling point. The purpose 
of generating of a model initially is not only to definitively describe a solution to a problem, 
but the development of a consistent and timely solution. As such, software models are 
commonplace to address these issues. However, the solution environment of software 
brings its own set of constraints to the modelling domain. Table 4 summarizes typical 
problems with traditional software modelling tools. 


• Poor visualization of model structure 

• Inadequate treatment of uncertainty 

• Poor documentation of assumptions 

• Cumbersome to review, revise, or extend 

• Insufficient iterative refinement 

• Inappropriate detail 

• Results not trusted by decision makers 


Table 4. Problems with Traditional Software Tools for Modelling. 
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2.4 Problem Summary 

On the basis of the direction provided by the US. Congress, coupled with the increasing 
maturity of A&R technology, space system development efforts are activdy pureiffng the 
use of automation techniques. Risk and task analyses are being performed to estimate the 
impact of including this technology. Management requires effective and timely projections 
by management to determine the viability of A&R implementation in the various 
programs. One means of justification is the use of LCC models to support trade-off analyses 
for profitability. The leap technology proposed warrants, if not requires, extrapolation 
methods and explicit handling of uncertainty. Software models are increasingly used to 
generated high fidelity projections of system performance. These , 

historically compiled assumptions and judgments into the model giving the end user little 
insight into the reasoning process. Confidence in the model results is reduced and is 
typically viewed with skepticism. 

The problem domain being addressed by this contractual effort is summarized by the 
following list: 

• A&R technologies appear to viable alternatives to current, manual operations 

• life-cycle cost models are typically judged with suspicion due to implicit assumptions and little 
associated documentation 

• uncer tain ty is a reality for increasingly complex problems and few models explicitly account for 
its affect on the solution space 


3. Objectives 

Two objectives were set forth at the outset of this study effort. The first objective is to 
identify and describe far term capabilities and requirements envisioned for the Automation 
Life-cycle Cost Model. Following definition of model requirements, the second objective 
establishes a framework development approach that supports achievement of the defined 
requirements. Figure 1 is graphical depiction of the relationship among the objectives and 

the ultimate ALCM tool. 


NASA CONCERNS 


PROBLEM 

DEFINITION 


FAR-TERM 

OBJECTIVES 


insHUsr, 


MATURE 

ROCKWELL 

RESOURCES 


NEAR-TERM 

OBJECTIVES 


ALCM 

FRAMEWORK 


ALCM 

TOOL 


Figure 1. The ALCM Tool is the Result of Cooperative Determination of Envisioned Capabilities 

Between NASA and Rockwell. 
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The far-term objectives document the envisioned capability within 3-5 years of effort. 

These objectives are consistent with the "ultimate" tool proposed by LCC analysts. This 
vision captures capabilities and shortcomings of existing tools. Near-term objectives are a 
little more "down to earth." Given the NASA concerns for LCC values and mature Rockwell 
resources, a compromise is reached on satisfying the "wish list" of far-term objectives. The 
n par -tprm objectives are capable of being included in an ALCM tool within 1—2 years of 
contractual effort. The overall goal of this contractual effort is the definition of these 
objectives and the generation of a software framework demonstrating the near-term 
objective capabilities. 

3.1. Far-term Objectives 

The capabilities of the ALCM will coi ncide with the issues outlined in Section 2.0 (Problem 
Statement), specifically: LCC analysis, task analysis and uncertainty analysis. It is intended 
that the ALCM should not simply be a high fidelity LCC tool, but one that assists in the 
design decisions and can give a manager the kind of information necessary to support 
programmatic and system decisions. Table 5 depicts the capabilities currently envisioned for 
the ALCM. ^ ■ • v. ■, 


General Capabilities 

Sensitivity/Tradeoff Analysis 
Capabilities 

Output/Display Formats 

• Assessment / Determination 
Tools 

• Temporal (e.g., duration, 
frequency) 

• Spreadsheet Paradigm 

• Risk Analysis 

• Quantity 

• Graphical 

• Temporal Representation 

• Sparing 

• Model Structure 

• Integration with Existing 
Databases 

• Manual vs. Automation 


• Security of Data/Algorithms 

• Level of Automation 


• Integrated Documentation 



• Multiple Fidelity Levels 




Table S. Far Term ALCM Capabilities Will Support Management Decisions And Ensure Low LCC With 

Identified Uncertainty. 


3.1.1 General Requirements 

Incorporation of the capabilities/requirements depicted in Table 5 represent: (1) the typical 
variables which would effect the outcome of an A&R versus ma nual trade study, (2) 
variables associated with what-if analyses the customer or program manager are likely to 
desire/request, (3) a method for rapidly and easily performing comparative tradeoff 
analyses, and (4) alternative methods to view data, that would present different perspectives 
of data. The model should be capable of easily and rapidly supporting comparative analysis 
and depicting results in an easily interpretable graphic or spreadsheet format. Any 
requirement that may arise to use either pre- or post-processors, or any other external 
module, in association with the main model/ environment shall be transparent to the user. 
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3.1 .1.1 Gen ial Capabilities 


The General Capabilities category of objectives includes those items that should be 
in the ALCM toofin its envisioned configuration to assist in the overall operability of the 

reflect the IperaBorri modes In whid. the mol corid be used. 

The following list provides a more detailed explanation for each of the parameters. 


• Assessment/Determination Tools-These capabilities provide a cost analyst the 

ability to derive costing relationships and drivers for particular applications. 

Items may include design, operations, and maintenance cost drivers. 

• Risk Analysis— These capabilities provide the ability to specify and model parameters 

in th/problem spacethat may contribute to the risk of the solubon _Decision 
analysis tools support the uncertain portions in the above specifications. 

Uncertain parameters may include cost, technology maturity, and sizing values. 

. Temporal Representation-The framework provides the capability to eqpUdtfy jnodel 
time-variant values and relationships. For instance, the tracking of cost elements 

over time is required. 

. Integration with Existing Databases-The ability to access 

of pertinent data greatly enhances tool confidence and reduces development risk. 
By capitalizing upon known quantities, the ALCM tool becomes a new inte ace 
to pre-existing models. This capability supports the other facets in this 
providing the raw data for analysis. The capability shall also be provided to enter 
new, and revise existing, data within the tool environment. 

• Security of Data/Algorithms— The exclusion of particular portions of the ALCM tool 

environment is required to protect sensitive and proprietary data from 
unauthorized access. The separation of usable and partitioned data under too 
control facilitates configuration management. 

• Integrated Documentation-The incremental development and evolution of _a model 

should be reflected in its documentation. The integration of documentation 
capabilities with the modelling parameters themselves encourages the updating 
of material. Explanation, legacy, and definitive information may be included. 

• Multiple Fidelity Levels— The ability to represent various levels of fidelity promotes 

prototyping of systems and accelerated definition of the problem *^ n ^\ Thls 
abstraction mechanism allows the user to concentrate on a localized aspect 
without the burden on the overall system. Multiple levels promote 
understandability by the end user through the reduction of clutter in model 

presentation. 
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3.1.1 .2 Comparative Analysis 

The Comparative Analysis capabilities of the envisioned ALCM tool provide the means of 
performing sensitivity and trade-off analyses. The exploration of alternative possibilities 
within the context of the tool environment is a powerful analysis ability. The rapid 
generation and examination of pertinent data displayed regarding other possible situations 
promotes the discarding of irrelevant or risky solutions. The testing of more situations also 
enhances the confidence in the ultimate decision supported by the ALCM tool 
Interpretation and experimentation within the confines of the tool environment reduce the 
chances of translation and transcription errors. The following list provides a more detailed 
explanation for each of the parameters listed in this category in Table 5. 


• Temporal — LCC inherently includes time-variant relationships and data. The 

associated analysis, likewise, includes the viewing of parameters as they change 
with time. Examination of those changes (or lack of change) may indicate 
significant performance of that system that ultimately affects the total system cost 
Examples of temporal representations include life-cycle duration, mission 
frequency, mission duration, and quiescent periods. 

• Quantity — The number of systems (and their constituent parts) and the extent of the 

missions involved heavily influence life-cycle costs. For example, the explicit 
representation of these parameters is useful for determining breakeven points, 
and optimal production values an d rates. Values may include number of 
operating systems and component quantities. 

• Sparing — Related to the Quantity parameter, the number of spares of a unit can 

heavily influence LCC. This value is dependent on the use of manual or 
automated means. The evaluation of this highly dependent parameter is useful 
throughout all phases of the life-cycle. 

• Manual vs. Automation — One of the main goals of this contractual effort is the 

generation of evidence to support trade-off analyses of the use of A&R. The ability 
to specify the use of automation at various levels of system design is an 
important feature of the ALCM tool. 

• Level of Automation— Automation is typically not a discrete function when 

implemented. Varying levels of automation are desirable to maximize system 
utility and minimize LCC. The specification and analysis of this parameter will 
heavily influence system design and LCC 

3.1.1 .3 Output/Disp lav Formats 

The Output /Display Format capabilities need to maintain consistency with traditional 
mechanisms of LCC analysts and provide new insight into the advanced capabilities of the 
ALCM tool. Legacy from models being implemented in database and spreadsheet tools is 
apparent from desired model outputs being tables and simple graphs. The addition to this 
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parameters: 


ALCM tool. 

e Graphical— Simple graphs of the V ^p 1 f with 

8180 ii «£l?5S? tSSZS** ,**** »< one 

^/ 30 -St 5U* distributions). 

# Model Structure— The ALCM tool models are envisioned as being highly f ® l< j dular 

underetandability. The techniques will have an associated grap 
representation that is both expressive and easy to use. 


? .? , Near-term Objectives 

identified objectives. Figure 2 provides a ^plucal repr^entanon 
Objectives within the context of the overall vision for the ALCM tool. 
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• GENERAL CAPABILITIES 

— Assessment/Determination Tools 
|®?Risk'Anajysis'^^ll^ 
iiiTwnporal Representation 

Integration with Existing Databases 




1 
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• OUTPUT/DISPLAY i 


. COMPARATIVE ANALYSIS 

: *- Spreadsheet Paradigm 


— Temporal (e.g., duration, frequency) 

— Graphical 


— Quantity 
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— Level of Automation 


: near-term 


Figure 2. Near-term Objectives are an Achievable Subset of the Envisioned Capabilities of the Final 

ALCM Tool. 


Within this contractual effort, the intention is to provide a proof-of-concept for the 
specified requirements of both the near- and far-term. As such, critical functionality will be 
demonstrated for this contract Critical functionality will be agreed upon between NASA and 
Rockwell International and be within scope of this contract. The specific objectives for this 
contract are listed below: 


|CMulltfe 


W 



• Provide conceptual development of ALCM with breakdown of modules 

• Identify any required external modules 

• Gather data appropriate to the capabilities of the model 

• Construct algorithms to support model development, as necessary to demonstrate pertinent 
capabilities of the ALCM tool 

• Begin development of graphical user interface (GUI) 


4. Approach 

4.1. Overview 

The approach being used is consistent with both the scope and objectives of this contractual 
effort The approach provides a demonstrable product that presents the envisioned 
capabilities of the ultimate ALCM tool This enables feedback from the intended end users of 
the ALCM tool to gain their confidence and improve functionality and performance of the 
tool. Table 6 summarizes the steps to be taken. 
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• Assess desirable capabilities 

— structure into near- and far-term 

• Identify useful existing models/ data 

• Identify parameters for utility analysis 

— cost — supportability 

— schedule — operability 

— element — interoperability 

— reliability 

• Define tool framework 

• Encode scenario thread for model validation 

• Provide transition path for tool development 


Table 6. The Approach Ensures an Interim Product to Assist Tool Acceptance and Validity. 

Underlying factors affecting the development of the ALCM tool include three analysis 
perspectives: cost, comparative, and decision. These facets are reflected in any efforts for this 
contract. By using these viewpoints, a more robust and useful tool is generated. Cost 
analysis is used in conjunction with task analysis to provide data generation and validation. 
Comparative analysis is used to analyze various possibilities for the use and timing of A&R 
in space systems. Decision analysis is used to explicitly treat uncertainty inherent in the 
problem domain. Table 7 provides a high level summary of the possible uses of these 
analyses. 


• Cost Analysis 

— Parametric vs. Empirical 
— Confidence 
— Validation 

• Comparative Analysis 

— Manual vs. Automation Alternatives 
— Automation alternatives 
— Phase/Component considerations 

• Decision Analysis 

— Avoid "point" decisions 
— Identify key drivers 
— Relevant level of detail 

Table 7. Utilizing Three Different Analysis Perspectives Provides the Opportunity for a More Robust 

and Useful ALCM Tool. 

The identification, capture, and utilization of existing data and models are structured 
around the life-cycle of a space system. Correspondingly, an accepted and valid 
representation of this cycle is required early in this contractual effort for meaningful 
progress to occur. Figure 3 shows the definition of that life-cycle as delineated by the 
following three phases: research and development (R&D), investment and acquisition 
(McA), and operations and support (O&S). This convention and nomenclature will be used 
throughout both this report and the entire contractual effort 
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4 2 , Existin g Model Identification 

Existing life-cycle cost models, relevant to A&R Utilized to 

Ssss^-»»jar- 

applications. 
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Existing modeb that might be assessed include, but are not limited to, the following: 

• Brilliant Eyes Cost Model — United States Air Force 

• Optimum Repair Level Analysis (ORLA) — NASA 

• Production Rate Adjustment Factors (PRAF) — United States Army 

• Atliss — United States Air Force 

• LCC1 — North American Aviation (Rockwell International) 

• Planetary Logistics Analysis and Evaluation Tool (PLANET) — Rockwell International 

The exbting modeb surveyed will be identified and comments noted in documentation. 
Hus report contains key features, attributes, and drawbacks (as applicable) for each of the 
modeb. Areas of applicability and usefulness for each of the modeb assessed are noted. 
Areas explored include: 

• launch to orbit costs 

• on-orbit replacement costs 

• advanced technology usage projections 

• man-tended systems costs 

• unmanned systems costs 

• advanced systems costs projections 

• constellation systems costs 

• user friendly man/machine interface (MMI ) independent of user skills 


Rockwell International Space Systems Division 


Page 15 



Automation Life-cycle Coat Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


Final Technical Report 


A summary of findings from the above list of models is shown in Table 8. 
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test, and evaluation) costs of robotic systems for commercial applications. However, the 
space program is lacking in this area in both ground processing and on-orbit applications. 

Appendix 9.5 contains information on the generation of qualitative robotics CERs. 
Conversion of this expertise into equations for inclusion occurs in a follow-on ALCM effort. 

Most robotics deployment and operation experience lies in the commercial sector. However, 
illustrative data points do exist for particular application as well as common off-the-shelf 
components. Appendix 9.6 contains these data. Initial complexity level definitions and 

estimates exist. 

Likewise, NASA defines technology maturity with Technology Readiness Levels. Table 9 
defines these levels. 


NASA OAST Space Systems Technology Model (May 1980) 

Technology Readiness Levels 

Level 1 Basic principles observed and reported 
Level 2 Conceptual design formulated 

Level 3 Conceptual design tested analytically or experimentally 
Level 4 Critical function /characteristic demonstration 

Level 5 Component/breadboard tested in relevant environment 
Level 6 Prototype/engineering model tested in relevant environment 
Level 7 Engineering model tested in sp ace 

Table 9. Use of NASA Technology Readiness Leoels Can Facilitate Risk and Development Cost 

Generation. 


Recurring operations and support costs associated with a given system typically dominate 
life-cycle costs. In fact, operations and support comprise 60% of the total life-cycle cost.[usgj 
Main constituents of these costs are maintaining spares' inventories and supporting a 
maintenance and repair infrastructure. The greater diversity of components, and more 
frequently items fail, then the greater will be the recurring operations and support costs. 
Therefore, it is vital to LCC to be able to estimate the failure rates of the components 
comprising a system. 

The Planetary Logistics Analysis and Evaluation Tool (PLANET) is a model, developed for 
use on NASA space systems, to predict failure rates for space systems equipment. It requires 
only minimal equipment definition data, that which is typically associated with conceptual 

phases of a program. 

It is a data base management system model, with several relational files that perform: 
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• determination of failure rates 

• estimation of maintenance demands over time 

• aggregation of maintenance demands for various systems/subsystems 

• sensitivity and tradeoff analyses 

• output of results in tabular or graphical formats 

Many of the features go beyond the ALCM requirements, in that the ALCM already has 
imbedded many of the features already or does not need them in die LCC analysis. It would 
appear that the centerpiece of the PLANET model, those files that determine failure^, 
would be its sole contribution to the ALCM. Attaching simple spreadsheet tiles ^to the .ALCM 
may accomplish this extension. Read and write protection of these spr^dsheetfil^is a 
vital requirement since the contained data would be Rockwell proprietary algorithms. 

Appendix 9.5 contains information on the generation of qualitative robotics CERs. This 
expertise is converted into equations for inclusion in the follow-on ALCM effort. 


4.3. Existing Data Source Identification 

The task consists of the effort to identify data available within Rockwell Internaticmal 
applicable to automating space systems. Currently known costing data that might be 
researched and assessed include, but are not limited to, the following. 

• Rockwell Shuttle Operations Company (RSOC) task manpower database 

• Rockwell International Space Systems Division Shuttle DDT&E cost database 

• Personnel Launch System (PLS) complete life-cyde cost analysis done by Rockwell 
International Space Systems Division (SSD) for NASA Langley 

• Rockwell (Independent Research and Development) IR&D project for post-landing thermal tile 
inspection process for the Space Shuttle 


A variety of data sources were examined during this period to identify information (either 
for use as CERs, or as constant-type variables) that would be appropriate for inclusion in the 
ALCM. The data sought, fell into two categories: (1) methodologies and/or algorithms 
related to parametric cost estimating/predicting, and (2) historical and/or accounting data 
that would enable the development of CERs. 

Seven different data sources were researched, besides ; the 7 1 

evaluated (refer to paragraph 4.3). A summary of findings is contained in Table 10. 


Page 18 


Rockwell International Space Systems Division 


Final Technical Report 


Automation Life-cycle Coat Model CALCM) 
NASA Ames Research Center 
Contract *: NAS2-13419 





Accounting 

Historical 

Applicable 
To AICII7 

Source Name 

Authority 

General Content 

CERs 

Data 

Earth To Orb* Si^port 
Syst am Concept Study 

SSD Internal Research 
A Development (Project 
00237) 

Contains ground prooeaeing and 
ground operations CERs related to 
dfflerent launch vehicles 

✓ 


YES 

Humans' Automation^ 
Robotka/Tatofobotioa 
Study 

NASA/JSC Report#: 
JSC 46106 

Contains operating time, manhours for 
monitoring and maintaining robotic 
systems lor a Lunar Baaa retails to 
SEi Option SA 


✓ 

YES 

MERGER Data Base 

Rockwel Shuttle 
Operations Contract 
(NASAOSC) 

Contains actual stjport marpwer 
expenditures lo import shuttle Might 
design, mission planning, etc. 


✓ 

POSSIBLY 

On Orb* Assembly/Servicing 
Task Definition Study and 
Advanoed Automation For 
In-Spaos Vehicle Processing 
Study (Combined Studies) 

McOonnall Douglas 
Study For NASA/KSC 
(Contract #: 

NAS 10- 11 400) 

Contains task times and tradas, 
between human and robotic assembly 
and processing of vehicles h apaot 


✓ 

YES 

PLS LCC Estimates 

NASA/URC Study 
(Contract#: 

NAS 1-1 8075) 

Contains Both Accounting and CER 
based estimates, resident in RCA-Prios 
model, lor fight weight reusable manned 
vehicle 

✓ 

✓ 

YES 

Shuttle DDTAE Data Base 

SSD internal Data Base 

Contains C ERs lor large mam laimch 
vehicles and launch vehicle subsystems 

✓ 


NO 

TVe RewaterprooTng Study 

SSD Internal Research 
A Development (Project 
00237) 

Accounting type data relating costs 
associated with the various elements of 
the TAs Rewaterprooftng Robotic 
System 


✓ 

YES 


Table 10. Summary Findings of Data Sources Reviewed. 


4.4. Advanced Technology Impact Determination 

This task includes the efforts to identify existing means for extrapolating advanced 
technology transfer to space systems. This may include the following efforts: 

• identification of existing methodologies within the industry 

• identification of existing methodologies within Rockwell International's Space Systems 
Division 

• modification of potentially applicable methodologies from other life— cycle costing disciplines 

When predicting costs for advanced technology systems, it is necessary for a model to be 
capable of trading varying levels of technology readiness, not only as an element of cost, but 
also as a risk or uncertainty factor. When addressing robotic technologies for space 
applications, there are three factors that drive technology requirements. 
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(1) * ohotic , ^ tems ‘ 

<2) 

mater robotic autonomy, as well as improved performance in myriad areas (i-e., 8 r ® at ®T 
SSd tSbity; self-healing; faster Lponse time in both manipulators and end effectors; 

improved visual acuity; and increased tactile sensitivity.) 

(3) Related to but beyond Factor #2, future robotic systems will need to be more ad fphve re 

^«Sive SSr dynamic operating environments. To accomplish ttus, robotic systems 

will take advantage of the emerging neural network technology, and 

I^wled^e based^ystems, to eiSkble more human-like heuristic learning and deductive 

reasoning capabilities. 

4.4.1 Assessment of Technology Drivers and Technology Readiness Levels for 
Robotic Systems. 

Ftart extemal/environmental factors are driving robotics technology requhements by 
SSs^eTphenomena that, in some cases, go well beyond the ^ni^nd ^b^t 
environment of earth's surface. In most cases these environmental factore drive matena 
selection (i e radiation hardening for nuclear applications; corrosion resistance and high 
strength requirements^or underwater application.) They can also drive other roboto 
STe^technology requirements, such as better visual acuity for low ambient hght 
conditions, as in space and underwater applications. 

In response to the second factor, technology improvements hnposrf by new P»fo/ man« 
requirements vary widely depending on the robohc systems application. It is best to assess 

these technology requirements by robotic subsystem. 


Platforms with different categories of payload capabilities and mission requirements will 
^r*eh ^wer Wain. clStsis, suasion and braking subalterns; as well as their 
portioning accuracy subsystems, and control and navigation subsystems. 
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(a) Power Train, Chassis, Suspension and Braking Subsystems - This particular subsystem is 
characterized by relatively mature technologies-due to robotic system, military, construction 
industry, and automotive industry developments and requirements. This is not meant to say 
that levels of complexity may change. Volume constrained spacecraft will impose special 
packaging requirements and terrain considerations may drive totally independent drive, 
suspension, and braking systems. 

(b) Positioning Accuracy Subsystems For The Mobile Base Platform - Again, this subsystem is 
characterized by relatively mature technologies-due to developments in the air/ ground 
segments of the military and commercial aviation industries, as well as work done in robotics 
fields. As accuracy requirements increase, different and/or integrated navigation systems 
will be employed to meet the particular requirement, which is more of a complexity issue. 

(c) Control and Navigation Subsystems - Control and navigation of the mobile base/ platform can 
be achieved by one of three methods: (1) teleopera ted / telepresence, (2) self guided, and (3) 
intelligent mobile base/platform. Control and navigation technologies are still maturing, and 
in some cases are only in the breadboard stage. Some of the driving technology factors are: 

• data transmission rates 

• integration of robotic sensory data, health and status data, as well as performance and 
relative position data 

• distances between remotely operated control stations and the robotic system 

• detection and avoidance of known and unknown objects 

• autonomous path planning, utilizing preprogrammed topographic maps and 3-D imaging 
systems 

• operating and maneuvering in a dynamic environment (where other objects in close 
proximity to the robotic system are also moving) 

4.4.1 .2 Manipulator Subsystems 

There are five separate components characterized by their own respective technology 
development schedules, they are: (1) Degrees of Freedom (DOF), (2) Reach, (3) Payload Lift 
Capability, (4) Manipulator Positioning Accuracy, and (5) Manipulator Command and 
Control. A combined discussion follows due to the synergistic relationship between DOF, 
Reach and Payload Lift Capability. Similarly, Manipulator Positioning Accuracy, and 
Command and Control will be addressed in aggregate. 
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DOF. Reach and Payload 

relatively mature due to robotics deve p . , advan ce ments are still required for 

gravity environment of space however, 1 ^ Pw l g* complexity is usually the driving 

’raised mechanism weight and control system complexity. 

(b) Manipulator Positioning Accuracy and control. ThereLe a 

S5S55^^SSS A^Sonaliy. interfaces between operator and the machine 
could also vary drastically depending on the requirements. 

,. Preprogrammed This is Item* 

ESZttZZPXl* This is . relatively mati.ee approach, depending on 
the task performance. 

* «**- - 

listed in the Mobile Base Platform section. 

3. Supervisory Control— The manipulator arm lCTdconunlmds atwTcan 0 

£:ssss‘-“!SS“'" 

4. Coordinated Motion— This system inv0 ) v ^ U '“^ e JX'^ 10 SS^g or^the task and 

coordinated to avoid damage to tZSZbS* on. or momsxis, 

SS^^TTJl^n«twork^*nso«to detect the force, and torque, in e«h 

axis. 

5. Task Based 

given to a robot work cell controller. _ arrord : ne i v if an anomaly occurs, the 

problem(s). 
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A A 1 ? Special To pis /End-effectors 

End effectors and end effector technology readiness are fonction/task ^” d ® nt n ^ ef ° re/ 
anv attempt to create a taxonomy of end effector technology readiness would be purely 
subjectfve^and oZlete in a short time. However, their respective purposes/functior« could 
be eenerically categorized to assist in understanding what is driving system costs. These 
categories are type of end effector (contact vs. non-contact), force/torque & micro 
positioning control, and machine vision. 

(a) Type of End Effector 

. Contact End Effector-Here the end effector is used to grasp or perform a function on an 
object. The most basic end effector is the parallel jaw, which is widely u^dfor * v ^»etyo f 
applications. Power tools such as screw drivers are another type of end effector. As the tools 
become more specialized, technology readiness can decrease. 

. Non-contact End Effector-In this instance, the end-effector moves an attached sensor 
system package to perform non-destructive testing (NOT) or monitor an on-going operation. 
Typically they cany a fixed mass. More complicated systems may be required to 
probes through maze-like systems, which may require more system flexibility and degrees 

of freedom. 

Force/Torque and Micro Positioning Control-Most end effector control s>*tems *re ! “!*oi 
part of the manipulator arm overall control scheme. However those which ^er ^ulh-DOF 
often possess their own closed-loop control system. These end effectors are ^eitherfor 
operations where delicate objects are handled or they are used as micro 
(the re-waterproofing end effector serves both these purposes). In each case tiie endeffector 
design becomes more complicated and more sensors have to be used to control forces, torques 
and positioning accuracy. Depending on the application, significant technological 
development is required with an accompanying dramatic increase in cost 

Machine Vision— Vision systems can be independent of the end effector. However, 
applications they are part of the end effector. Most vision systems currently used are off-the- 
shelf and operate under specific operating environments. These vision systems can be 
fnfeg^ted Ea system SsUy and their costs are relatively modest. Costs for vision systems 
increase as they migrate to unstructured environments. Sample vision system applications 
include: 

1. Inspection and monitoring— Typically used to locate and identify spedfic feat^ undCT a 
varying light/shade and orientations. This type of vision system capability may not be 
available off-the-shelf and could require a sizable development cost. 

2. Guidance, path planning and collision avoidance-Along with the aforemention^, 
interpretation of images and map generation (2-D and/or 3-D) capabilities ** 
required in this type of vision system. This type of requirement is c ^ racten ^ l by * tow 
level of technology readiness, and development of this capability will require a 
substantial research and development investment. 


<b) 


(c) 
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Finally, technology related to imbuing robotic systems with more human-like cognitive 
capabilities is presently 'over the horizon' and is very dependent on what happens in the 
neural network and advanced logic technology arena. 


4,4.1 .4 Rockwell Space Systems Division In v olvement in Robotics and Relate 
Technologies 

The robotics group at SSD has a laboratory with a number of different systems and end 
effectors for performing tests and a wide range of analyses. They have supported 
development of robotic systems requirements for space applications and have been active 
participants in NASA robotics related activities. They also have worked with the Oakndge 
National Laboratory, in developing robotics requirements and systems related to the 
nuclear power industry and other public and private institutions. Members of this group 

include: 


• co-chairman of the American Institute of Aeronautics and Astronautics (AIAA) Robotics 
Standards committee 

• participants on die Humans/ Automation/Robotics/Telerobotics (HART ) Working Group 

• participants on the NASA/DoD/Industry Space Assembly and Servicing Working Group 

4-4.1 .5 Identification of Existing LCC Methodologies 

The SSD robotics group has been involved in the development of a number of robotic 
systems, including the Tile Rewaterproofing System for NASA-KSC. In each case they have 
access to actual cost data, however, they have not had the requirement imposed on t hem to 
aggregate the data in such a manner to enable them to turn the accounting data into CERs. 
ifie life-cycle cost of a robotic system is compared with that of other alternatives. However, 
it is as important to quantify the benefits that different options offer to the operation or 
m issi on scenarios and include them in the LCC model. 


Net Cost = SUM(DDTE k Operation Cost)-SUM(Quantified Benefits) 

This will require development of an end-to-end cost dynamic model of the overall Program 
(system and/or environment). This model should allow for an overall Program cost 
calculation over a given period. It should also be able to calculate the cost and benefits 
associated with different Program components. Such a cost model could be used to evaluate 
cost impact of a system change over the whole Program. During Phase B of the Space 
Station Freedom, NASA JPL proposed the development of a similar cost model and 
published a number of papers on the subject. Furthermore, Rockwell during the same 
period, concentrated on the development of techniques to isolate and evaluate system net 
costs. Here, the objective was to identify a set of boundary conditions for a given system that 
allows the inclusion of outside factors to the system cost Both techniques along with others 
offer the building blocks for a comprehensive LCC Model. As more cost data becomes 
available, different portions of the model could be tested and verified. 
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4.5. Decision Modelling System (DEMOS) Tool Capabilities 

Decision Modelling System, DEMOS, is an interactive environment for structuring, 

communicating probabilistic models.^ It allows the co^ct.on of p^blem 
domain mathematical representations with explicit treatment of iince y- 
defined within DEMOS can be either deterministic or probabilistic The DEMOS 
cotTuHo ^ eng^ris capable of handling a wide variety of functions in bo* regimes of 
variable types, including their various combinations. 

DEMOS executes on Macintosh computer hardware platforms and, therefore^confonns to 
easily usable user interface conventions and protocols. DEMOS was constructed to be highly 
interactive and tailorable. Table 11 summarizes its key features. 

Influence diagrams display model structure 
Hierarchical structure helps organize large models 

GrapW^^mrirte 6 and prrA^i^ti^vatccrtainty analysis help identify hey sources of 
uncertainty 

Non-procedural modelling language reduces programming effort 
Array abstraction allows flexible construction of multidimensional models 
Hypertext model with integrated documentation supports collaboration and sharing of models 
Libraries of functions support customizing for particul a r classes of application 

Table 11. DEMOS is a Highly Flexible and Appropriate Environment for the Solution of LCC Problems. 

Given these general capabilities, a mapping has been construrted of percent tDEMOS 

features and their envisioned utilization for the ALCM tool. Plans include : 

and integration of existing data and models into the tool. The demonstration developed^ 

during thte contractual effort attempts to provide a ^ ics ^ usa 8 e of c f 

In this way, the power and flexibility of DEMOS can be used to demonstrate the validity of 

the ALCM^ooL Table 12 summarizes the intended usage of DEMOS features. 



UNCERTAINTY analysis 
MODELLING LANGUAUt 

ARRAY ABSTRACTION 

INTEGRATED DOCUMENTATION 

LIBRARIES 


I dentify cost drivers 
Provide function flexibility 
Complex mappings of elements in the life-cyde 
Multidimensional trade space 

• Incorporation of existing data 

Structured presentation of critical information 
(validation, heritage, explanation, etc.) 
Development of a tailored library of functions 
explicitly constructed for the ALCM tool 


Table 12. DEMOS Features Can Be Easily Tailored for the ALCM Tool. 
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5. Automation Life-cycle Cost Model (ALCM) 

5.1. Overview 

The ALCM is a life-cycle cost analysis framework developed using the DEMOS application. It 
provides parametric and accounting capability for development, acquisition, and operation 
and support phases of the life-cycle. Figure 4 shows the ALCM methodology flow of the life- 
cycle cost process. 


ALTERNATIVE PPOZP+M PARAMETER! 



DEMON 

system concepts 


Figure 4. life-cycle Cost Methodology Flow Interfaces With All Aspects of a Program. 

Development of an LCC estimating/prediction model requires a rigorous effort to capture 
all data relevant to the program and system being modeled. If used to influence system 
design and operations decisions, the model must have the inherent capability to allow 
designers /analysts to perform, in real-time, subsystem/element cost tradeoff /sensitivity 
analyses. Finally, the LCC model needs to have the flexibility to "report" costs from various 
perspectives, which reflect different customer perspectives, i.e., program managers, ground 
segment managers, spacecraft segment managers, risk management personnel. Figure 4 
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fflustrates the program and system inputs, engineering economic analysis capability and 
reporting capabilities contained within the ALCM. 

The model needs to be able to capture A. MU >* l^ddSTu the 
engineering opportunity. In . a genenc model Similarly, 

such things as discount rates, labor ^ (JJbs). Eve Jy program has its own 

generically, is the program work brea ^J® , . , l ls they a u generally contain the same 

SSSsSSSrito “ 

programs, are defined in Section 5.2.1. 

To perform engineering economics £££ 

hardware/software system metrics that define and s P t CERs 

costs. The ALCM is generic in the sens, that I £»«■ / m «Er such 

and engineering/integration relationship. determine a specific 

engineering economics and LCC analyses: 

• Identification of cost drivers 

• Depiction of risks <e.g., uncertainty in numeric values) 

• Performance of comparative analysis 

• Performance of cost/benefit analysis 
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Following program and system definition, the ALCM is capable of quantifying and reporting 
costs in a number of different formats and perspectives, depending on the particular user 
and need. The aggregate costs can be viewed from the following perspectives: 

• Cost-risk 

• Costs by program phase 

• Costs by WBS • 

• Hardware/software costs (e.g., to support Design to Life-cycle Cost [DTLCCj ) 

- by program phase, and/or 

-by WBS 

• By any combination of the above 
5.2. System Architecture Definition 

The ALCM architecture provides for generic life-cycle cost categories and specific program 
work breakdown structures (WBSs). 
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5.2.1. Generic Life-cycle Cost Categories 


Figure 5 depicts the phases of a life-cycle in the ALCM. The Operation and Support phase 
includes the disposal of the unit 
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5.2. 1.1. Research and Development (R&D) Ph ase Cost Categories 

Table 13 lists the R&D cost elements. This phase of the life-cycle includes Definition (Phase 
0), Demonstration & Validation and the Engineering and Manufacturing Development 
phases of R&D. The categories shown in Table 1 1 may be expanded to a lower level if the 
program requires. 


PRIME 

APPROPRIATIONS 

DEFINITION 

REFERENCE 

COST ELEMENT 


1.0 

RESEARCH AND DEVELOPMENT 

RDTE 

1.01 

DEVELOPMENT ENGINEERING 

ROTE 

1.02 

PRODUCIBILfTY ENGINEERING AND PLANNING (PEP) 

RDTE 

1.03 

TOOLING 

RDTE 

1.04 

PROTOTYPE MANUFACTURING 

RDTE 

1.05 

DATA 

RDTE 

1.06 

SYSTEM TEST AND EVALUATION 

RD/OM 

1.07 

SYSTEM/PROJECT MANAGEMENT 

RD/OM 

1.06 

TRAINING 

RD/MC 

1.09 

FACILITIES 

RDTE 

1.10 

SOFTWARE 

RDTE 

1.11 

OTHER 


Table 13. Research and Development Phase Cost Category Definitions. 
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invec f^pnt ana Acquisition UftA) thm 0°$* Category 

Table 14 identifies the cost rate |®^^^eoI^g StS taSri ' teploy^ 1 and other 

*— to Table 12 may 1,6 10 a ,ower 

if the program requires. 




PRIME 

APPROPRIATIONS 

definition 

REFERENCE 

COST ELEMENT 

PFVMC 

2.0 

2.01 

investment AND ACQUISITION 
non-recurring investment 

PROC 

2.02 

PRODUCTION 

PROC 

2.03 

ENGINEERING CHANGES 

PFVOM 

2.04 

SYSTEM TEST AND EVALUATION 

PR/OM 

2.05 

DATA 

PFVOM 

2.06 

SYSTEM/PROJECT MANAGEMENT 

PFVMC 

2.07 

OPEFtATIONAL/SITE ACTIVATION 

PFVOM 

2.08 

TRAINING 

PFVOM’ 

2.09 

INITIAL SPARES AND REPAIR PARTS 

PFVOM 

2.10 

transportation 

PR/OM 

2.11 

FACILITIES 

PR/OM 

2.12 

OTHER 


Table U Investment ani Acquisition Phase Cost Category Definitions. 
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5.2.1 .3. Operation and Support (O&S) Phase Cost Categories. 

These costs begin at initial operating capability (IOC) and continue through disposal of the 
unit. The cost categories apply to launch operations and support, orbit operations, mission 
operations and support, de-orbit operations, and landing operations and support and 
disposal. The categories shown in Table 15 may be expanded to a lower level if the program 
requires. 


PRIME 

APPROPRIATIONS 

DEFINITION 

REFERENCE 

COST ELEMENT 


3.0 

OPERATION AND SUPPORT 


3.01 

PERSONNEL 


3.01.1 

CREW PAY AND ALLOWANCE 


3.01.2 

MAINTENANCE PAY AND ALLOWANCE 

- 

3.01.3 

INDIRECT PAY AND ALLOWANCE 


3.01.4 

FLIGHT PAY AND MISC 


3.02 

MISSION OPERATIONS AND SUPPORT 


3.03 

ORBIT OPERATIONS AND SUPPORT 


3.04 

DEORBIT OPERATIONS 


3.05 

LANDING OPERATIONS AND SUPPORT 


3.06 

MAINTENANCE 


3.06.1 

LABOR 


3.06.2 

MATERIAL 


3.06.3 

TRANSPORTATION 


3.07 

SPARES 


3.08 

TRAINING 


3.09 

DOCUMENTATION 


3.10 

SUPPORT AND TEST EQUIPMENT 


an 

SOFTWARE MAINTENANCE 


3.12 

DISPOSAL 


3.13 

FACILITIES 


3.14 

OTHER 


Table 15. Operation and Support Cost Category Phase Definitions. 
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522 . Specific Cost Categories 

Within each of the generic modules of the model, by phase, the specific program WBS that 
applies to that phase of the program will be tailored to fit the program being analyzed. 
Figure 6 shows an example of the format that will be seen on an output report from the 

ALCM. 





53. Model Development 

Model development was driven by the long-term objectives of this effort within the system 
architecture definition (as specified in Section 53). Traditional life-cycle costing techniques 
were used to specify the model content The ability to use both top-down and bottom-up 
approaches within the model was an objective. The ability of the model to respond flexibly 
to differing requirements and situations of various programs was a stressing requirement 
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ThP deds Ion was made to utilize a weU-known and understood application to drivethe 
•pie decision was maa g Space Systems Division's experience with robotic 

Sps xmsssk sr Not 

Subsequent subsections provide background information and the decision ^^S Process 
^TSSruid to consider and, finally, select the tile waterproofing application as the 
^f^tion fo?our m^S Its apparent extensibitity to space-based systems was taken 
current contract knowledge of ffigM l robodc systems and proposed 
efforts for future space mission (e.g.. Moon and Mars expeditions). 

5.3.1 Background 

Boeing Company conducted a study to identify and evaluate] ^^““‘^Sbiter 
applications toimprove Space Shuttle ground processing ^tween ^ghte at t he Orbiter 
Processing Facility (OPF). One hundred and thirty-eight tasks were identified o 
top^memtatiie current process. The top eight were prioritized and described in detail. 

Three of these are as follows: 

i Til# R#-waten>roofine — Over 22,000 ceramic tiles are used in the Space Shuttle 
' Thermal Protection System. These tiles are precisely installed and ^eir operab^ty is 
altered by environmental conditions prior, during, and after ^'An 

effective method of tile protection is waterproofing. The chemical used for this 
protection is consumed during the flight, so it must be replaced. 

The current method involves dimethylethyloxysilane, which is a toxic compound, and 
^W^to^-intSsive. The current process now takes about five days and must be 
executed during the third shift for safety considerations. 

A mho tic system has been proposed and currently is in various stages of development 
The system^ involves a mobile base, manipulator, vision system, tile re-waterproo g 
end-effector, and workcell controller. 

Design and proposed development costs are known for system for this application. 
Projected O&S costs are also known. 

flight More attention is concentrated on the height of the leading edge wing t es/ 
however. 
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waterproofing application. 

pffla as mature as the re-waterproofing application 

progress. 

5.3.2 Approach 

The family of terrestrial applications listed •” * c prt rrious s^io: ^^“^^rrand process 

fo/a^^^^^OTToffCTS^o wrete^M^ ^ ** 

^^^^^“ p-vides a means for extrapolating 
implementation in non-terrestrial deployed systems. 

Figure 7 graphically presents the general approach taken for model development and is 
summarized in the following list 

• Waterproofing application is used to generate CERs 

. Resultant model is used to predict Step and Gap and/or bonding application costs 

• Use of PLANET data and modelling capabilities will be implemented within the ALCM 
framework to provide vision to far-term space system modelling. 
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LIFE CYCLE COST 


PROGRAM ACQUISITION COST 


J 


l 


INVESTMENT 

COST 


J 




CONCEPT* 

EXPLORA1KM Dd40NTmATK» BKMNEEJWM * 

. ADCFMmW A VAUDATWN MANUFACTUMNO . 
I PHASE PHASE DEVELOPMENT PHAS| 


joPERATlNO 4 SUPPORT COSTS^ | 
fOPCIUTINQ 4 SUPPORT PHASE | 





• RE-WATERPROOFING 
► STEP & GAP 

• BOND INTEGRITY 



Shuttle Operations 
Task Manpower Database 


Figure 7, The ALCM Approach Capitalizes Upon a Large, Known Body of Pertinent Data, Advanced 
Robotic Applications, and Standardized Costing Methods to Address the Entire Ufc-cycle Cost for 

Space Systems. 


This approach permits the generation of CERs that can be readily validated using internal 
Rockwell knowledge and experience coupled with data available from the NASA center 
sponsoring the robotic effort (NASA Goddard). Given the close relationship of the tile re- 
waterproofing, Step and Gap, and bonding applications, it was determined that the CERs 
developed from the first application would be appropriate for the other two. Since those 
efforts are currently in progress, or very nearly so, the urgency and realism provided 
increases confidence in the ALCM results. Also, known space-based robotic efforts can be 
related to this suite of applications to generate a legacy for ALCM costing of flight systems. 

The PLANET model, generated under NASA contract NAS9-18344 (Planetary Surface 
Systems Maintenance Assessment Study), addresses the logistical aspects of deploying 
manned bases in non-terrestrial environments. This model generates OScS reliability and 
maintainability data that will feed into the ALCM modeL These data are used to derive cost 
figures for that phase. The integration of the PLANET model into the ALCM framework is 
outside the scope of the current effort However, preliminary investigations have been 
conducted into the viability of that integration. There appears to be no great technical risk 
associated with that extension of the ALCM framework. 
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At, explicit requirement made early in this contract was that the junction 
framework hebased on generally accepted practices and prinop es within the LCC domain. 
The following list contains the explanation of this requirement: 

— This methodology includes the following items and relationships: 

• Life-cycle Phase Definitions — This definition includes all costs associated 
with a program, from conceptualization through disposal. Program 
development (including research and development), acquisition 
(investment), and operating and support costs comprise lif«yde cost. 

• Program WBS — Identifies and defines elements of a system for all pertinent 
phases of the overall life-cycle. This structure is typically hardware-oriented. 
The structure is a hierarchical tree. 

• Cost Categories and Elements— This representation is accounting-based. 
Accepted elements are defined for the Research and Development, 
Investment and Acquisition, and Operation and Support Phases. 

• Mapping of WBS to LCC Phase— The matrix defined by relating WBS 
elements to cost elements is always program-unique. However, generic 
WBSs and cost elements are known. 


— Automation techniques are to be applied during the system design definition. 
Automation of systems, subsystems, components, modules, and line replaceable 
units (LRUs) is possible. However, experience indicates the subsystem^ level is 
sufficient for most situations. The representation of automation capabilities > is a 
continuous function. However, its definition within this version of the ALCM 
framework will be a discrete function. 

— The ability to specify and revise CERs is crucial to the intended operability of the 
ALCM framework (and eventual tool). A minimal set of 3 formats is supported. 


1) Parametric CER— This CER is experience-based and expressed in alternative 
program parameters. This relationship has been derived through iterative 
analyses of previous systems guided by "technical analogy. That is, similar 
elements within previous systems are used as the independent variable 
while other terms are varied and graphed. A suite of these graphs is 
analyzed to produce the CERs. 


2) Accounting-based— This format is similar in intent as the parametric CER. 
However, the terms in the equations are extracted from accounting data and 

production rates. 


3) Throughput (vendor quote)— This format typically has the simplest form of 
the three possibilities. This equation is based directly on known production 
capabilities. 


An implicit (desired) capability for the ALCM framework is the entry of new relationships or 

the revision of presented CERs. It is envisioned that the ALCM become 

interface for accepted data and CERs applicable to the automation and robotics for space 
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sy stem s The construction of an all-encompassing cost model for this purpose is probably 
not realistic nor desirable. However, the use of the ALCM for capture and usage of pertinent 
data is desired. Section 7 contains a series of suggested improvements to the current ALCM 
framework prototype. In that section, discussion includes the relationship of the ALCM and 
other cost modelling resources. If the ALCM can be used as a starting point that is integrated 
into the design process of future space systems, then its objective will have been 
accomplished. 

533. Development of Cost Estimating Rationale For Robotic 
Systems/Subsystems 


For this phase of the ALCM development, development of preliminary cost estimating 
rationales support top-down/ parametric estimates. The equations listed below are only 
preliminary, since their basis is two data points. These data relate to the information 
acc/v-iatpH with the Tile Rewaterproofing Robotic System (Test Case 1) and a simple generic 
robotic system (Test Case 2). Rockwell's SSD Robotics Group provides all the data to the left 
of the 'SUM' column in both Tables 16 and 18. During a follow-on study, updating these 
equations reflects analysis of other robotic systems and their attendant costs. The purpose of 
the two tables was to determine the respective sigmas (o) and lambdas (X). Once determined, 
they apply to the Equations #1 and Equation #7 respectively. 

Table 16 and Equations #1 through #6 in Table 17 associate with mobile base platforms for 
robotic systems. Equation #1 is the aggregate expression to estimate cost given the 
parameters for payload capability, positioning accuracy and type of control mechanism, and 
respective complexities and technology readiness factors. Equations #4 through #6 depict 
the mathematical expressions to account for cost impacts due to the three driving factors 
associated with mobile base platforms. 



Table 16 Spreadsheet Analysis of Mobile Base Platforms To Determine Calibration Coefficients. 
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Equation #1: MBP$$= X • e*® 

Equation #2: X- 18.1068 

Equation #3: o - -1 .0693 


CPCLIx kw4 + (PAL 2 x im2) + (CNL3x xw3^ 


Equation #4: PCL1 = (LOG Jwt x 2. 5)) x (CL + l) x J 


Equation #5: PA12 = (CL + D x 

Equation #6: CNL3 « (CNTL Type ) x (CL + l) x [ 6 ~ 8 — J 


Table 17. CER Generation is Highly Reliant Upon Experienced Personnel and Mathematical Expression 

Manipulation Tools. 


Table 18 and Equations #7 through #14 in Table 19 associate with the manipulator 
subsystem components for robotic systems. Equation #7 is the aggregate expression to 
estimate cost given the following parameters: 

• # of degrees of freedom 

• reach capability 

• payload lift capability 

• positioning accuracy 

• type of command and control mechanism 

• respective complexities and technology readiness factors. 

Equations #8 through #14 depict the mathematical expressions to account for cost impacts 
due to the five driving factors associated with manipulator subsystems. 
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T«We 1«. Spreadsheet Analysis of Manipulator Systems To Determine Odibratian Coefficients. 



Toble 19. The MaMpnlator System CER Uses oil Associated Major Design Parameters. 


- 

relative complexity of the CER equation format. 
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Figure 8. Reach-related Costs Rise Quickly Over 40 Feet. 
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Figure 9 


i payload Capability Cost is Very Dependent Upon Weight Until Around 2 00 Pounds. 
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Figure 10. Cost Associated with Positioning Accuracy Rises Dramatically with Requirements Less than 
5 0.1 Inch. 


5.4. Framework Prototype 

The framework prototype generated during this contractual effort is envisioned as a 
precursor to the ultimate cost modelling tool. This framework provides a proof-of-concept 
and user interface testbed to facilitate requirements' definition and tool utility. The 
evolutionary approach to the ultimate tool's construction benefits both the developer and 
user. Incremental releases of the software allow the true intentions of the user be 
incorporated into the software model. Discoveries of new or different requiremente may 
occur throughout the life-cycle of the software. The user is not "stuck" with the delivered v 
software at the end of the contract. 


This section describes the capabilities of the framework, its implementation details, and 
provides a mapping to show how the prototype has met its objectives for this program. 


5.4.1 Framework Overview 

Section 3 describes the objectives for this program. They are dKompo^ into two n^» 
partitions: near-term and far-term. The framework prototype developed for this program 
responds to the near-term objectives with the far-term set accounted for in the envisioned 
growth plan for the software. Figure 11 (Figure 2 is repeated here for convenience) 
documents the near-term objectives demonstrated in the prototype* 
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r 

• GENERAL CAPABILITIES 

— Asses«rwnt/p«teiTrm^ Tool* 

— Security of Data/Algorithms 

1 


— Integration with Existing Databases 

feMutopi* RdaWyUvel* 


I 

L 




J 

r 

. OUTPUT/DISPLAY 

— Graphical 

• pie 

• So/30 iMiiMi 

" • COMPARATIVE ANALYSIS 
— Temporal (e.g., duration, frequency) 
— Quantity 
— Sparing 

^ Manual vs. AuttttiatWV 

1 


^ — Levei of Automation 


J 

1 gg|:;g : near-term 



Figure 11. Near-term Objectives are an Achievable Subset of the Envisioned Capabilities of the Final 

ALCM Tool. 

The capabilities of the framework prototype are categorized into 3 main areas: general 
capabilities, output/display capabilities, and comparative analysis. Figure 11 provides a 
graphical summary of the 3 categories. The Rockwell approach to capitalize upon the 
DEMOS development environment permits the categories to be actualized and therefore its 
features are subsumed by the other categories' capabilities. DEMOS allows the timely 
development of the framework's features but is not an intrinsic requirement for the ALCM 
framework. Its use reduces risk and cost associated with the sophisticated features of the 
model's implementation. Appendix 93 contains a graphical tutorial on the use of DEMOS. 

The General Capabilities implemented in the framework prototype include: 

• Risk analysis 

• Temporal representation 

• Integrated documentation 

• Multiple fidelity levels 

The prototype supports risk analysis in several ways. First, the ability to specify and model 
parameters in the problem space that may contribute to the risk of the solution. Second, 
decision analysis mechanisms, provided by DEMOS, support the association of uncertainty 
to objects within the model Uncertain variables are not imposed by DEMOS. However, the 
variables chosen to be probabilistic in the prototype Include cost, technology maturity, and 
sizing values. Lastly, sensitivity analysis may be performed to identify key drivers in the 
model. 

Temporal representation is handled by the explicit modelling of the life-cycle phases. Costs 
may be allocated to the appropriate phase of the project in question. Costs may be evaluated 
at two levels of granularity, the 3 main phases and their decomposition (refer to Figure 5 for 
the life-cycle phase definitions). 
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environment. 

.si., 

SSSSSs— =» J ' 

model. 

The Output/Display Capabilities implemented in the framework prototype include: 

• Spreadsheet paradigm 

• Graphical display 

• Model structure 
■n* spreadsheet 

r-sEK - — 

"cells" within the same matrix. 

«^S=S5333 f ‘ 

srSs&x=5^^»SJr 

SScfp P rot y oioU on the Macintosh ptatfonn, providm SSS^StZ^SZ^ 
Information in a variety of formats. Histogra m an d toe dra.^ p t TradM ff 

SS£ ££££*£ r d : hyTde^« The r IS afie ,0 switch h«ween 
histogram and line chart preferences throughout the model. 
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Model structure is presented grephiceUyto a 

influence diagrams and hi *” rc f ucal ^ and manipulate models (refer to Figure 12). 
standardized charting methodology to de satfefies the qualitative nature of the 

Explicitly displaying rebhonslups^ong van^ ^ ^ Ascription that is the basis 

problem. Influence diagrams also have a . been added to the classic 

for much of DEMOS' power. HienmWcal f odd^frucbon ^ ^ 

^phS^^ght taXo^m^o^ ' 

i&SSssS^si zasaar — - 
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5.12 Major Components 

The ALCM framework prototype consists of several major components that address cost 
modelling over the life-cycle of a space system. A separable portion of the framework 
addresses the software elements of a system using an industry-accepted methodology. The 
major components have been structured such that the software cost elements are explicitly 
noted and integration of the two portions is eased. Also, the use of one portion of the 
framework does not require the other. However, their use in concert greatly expands the 
modelling capabilities of the system. 

The major components include: 

• Phase definitions 

• Rate breakdown 

• Program-specific (Work Breakdown Structures) WBSs 

• Cost analysis features 

• Automation bottom-line analysis 

The software cost modelling portion is an add-on extension to the framework and is 
discussed in its own subsection. 

Figure 13 portrays the top-level of the framework prototype within the DEMOS 
environment. 
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54-2-1 Phase Definitions 

As noted in Figure 13, the lifecycle phase definitions indudetwo If™!* ° f “Sute ^er 
the maior phare level and, second, at the cost categoty level TOs capability pemuts the user 
to review Mid evaluate information at the appropriate level of detail to lus or h “ 
rMuhements The major phases include Research and Development (RAD), Investment 
ITamu WHon (I A^), and Operation and Support (OAS). Tables 13-15 depict the cost 
^tgoTdSwTha^ Figures 14-16 show the prototype's implementation for each 

phase's decomposition. 
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Figure 14. The Research and Development Cost Categories are Implemented as a List Which is Capable 

of Being Edited. 
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Figure 16. Operation and Support Costs Typically Account for the Bulk of Life-cycle Cost and Can Be 

Reviewed in Detail. 


These elements are coded as lists that can be easily revised. These lists are indices in the cost 
analysis portion of the model to allow review of cost by phase and cost category. 

5.4.2.2 Rate Breakdown 


Rates define the relationship between elements and labor, and the system's cost This factor 
is highly variable and dependent upon several mitigating factors that include year of 
execution, type of accounting method, and even geographic location of the work being 
performed. Further complicating the situation is that a life-cycle of a space system is 
typically expressed in years. Inflation affects the dollars in a particular year when compared 
to those spent in another. 

The ALCM framework accounts for this volatility of rates within the cost modelling domain 
by dedicating a submodel to the rate breakdown. This submodel is also responsible for 
converting between those cost elements that are best expressed in dollar amounts to those 
efforts expressed in hours. The framework relates the dements in the dollar domain. 
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Four main element types comprise the rate breakdown (refer to Figure 17): 

. Capital rate — used to specify those elements best described in dollar amounts 
. Labor rate — used to specify those elements best described in hour amounts 
• Rate vectors— conversion between dollar and hour amounts 

. Inflation factors-time-phasing of money to account for using standard-issue inflation 

factor tables 
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capability also supports modelling costs when elements of a F° ^ ^ essential 

Ramifications of Schedule slippage will be a future capability of the ALCM, but its essential 

elements are present in the current framework. 


§ A 2 3 Program- specific WBSs 

Implementation of a system using manual or auto^t^ tKh^quesJ^^ently rdies upon 
. diffprpnt set of hardware and software components. The WBS is a mecnanism useu w 

contained in each submodel is unique for that manual or automated system, 
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Figure IS. The ALCM Framework Supports Multiple Cost Estimation Methodologies and Their 

Comparative Analysis. 


In particular. Figure 19 shows the various ALCM framework cost estimating capabilities. The 
manual option uses bottom-up estimation with accounting data. The automated option 
uses both accounting data and parametric relationships for bottom-up costing and CERs for 
top-down estimation. 
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Figure 20. The ALCM Framework Prototype Provides a Flexible Environment for Constructing and 
Reviewing Space System Cost Models Based on Work Breakdown Structures. 
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54.2.4 Cost Analysis Features 

The cost analysis features provide mechanisms to compare the manual and automated 
implementation methods of space systems. Costs may be examined by method and by phase. 

Figure 21 provides the graphical screens of the prototype showing the cost breakdown by 
phase and method. Histograms depict cost by phase for each option while line chart shows 
the uncer tain values associated with the methods. Histograms permit the user to quickly 
ascertain the key drivers of cost for the various implementations. Line charts present 
uncertain variables in those areas where firm numbers are not known, required, or 
available. 



Figure 21. ALCM Framework Provides Cost Analysis Capabilities to Review Cost by Phase and 
Element to Determine Key Drivers in the Life-cycle. 

54.2.5 Automation Bottom-line Analysis 

The ALCM framework prototype provides a quick-look capability to examine the relative 
cost benefit from a manual or automated implementation. This single measure-of-merit 
may have an uncertainty associated with it based on the composition of the underlying 
model parameters. This analysis allows review of the bottom-line for the potential 
implementation options without being weighed down in the intricacies of the model. Of 
course, the user may examine the model to all its levels of details if one wishes. However, 
detailed perusal of the model is not required to obtain the answer generated by the model. 
Figure 22 portrays the information available from this quick look capability. 
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Using IR&D funds, Rockwell International's Space Systems Division has created a COCOMO 
model within the DEMOS environment entitled Autotrade. Autotrade is an embodiment of 
the intermediate COCOMO model as described in [lj. Autotrade also includes the following 
features not found within that standard model: 

• Autonomy levels 

• Probabilistic variables 

• Sensitivity analyses 

These additional parameters provide a unique flexibility to tailor the cost model to space 
systems in particular. The degree of sophistication for system capabilities and the efficiency 
of the software process affects the development and deployment of a system. Decision 
analysis permits real world considerations to be accounted for with probabilities and 
uncertainty associated with engineering estimates. Description and analysis of the software 
domain within decision analysis constructs allow detailed examination of the key drivers 
within the model and their relative relationships to other variables in the domain. 

5.4.2.6.1 Autotrade Overview 

Autotrade is a hierarchical software costing model built within the DEMOS environment. 
The top level consists of major definition and analysis components (refer to Figure 23): 

• COCOMO cost drivers 

• Size and productivity 

• Autonomy levels definition 

• CSCI identification 

• Summary analysis 
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Figure 23. Autotrade is Functionally Partitioned to Ease Navigation of the Mode l 
The cost drivers element assigns the qualitative cost drivers to n^ 

calculations. The size and productivity portion permits specification of Computer Software 
Configuration Item (CSCI) size and the amount of reuse anticipated within the 
SS and deployment of the software system. Productivity values are derived from 
these inputs. Autonomy levels per CSCI establish the sophistication of software capabilities 
at a system level. Allocation of qualitative values assigned to key cost factors used by 
COCOMO identify the CSOs. The user observes composite cost and productivity measures 

from the top leveL 
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S.4.2.6.2 COCOMO Cost Drivers 

COCOMO 1 s concept of operations 18 ^“MathematSl romWnSlon^f 1 ’ 
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*e ta^radon a^ provides an identification f or each of the factors. 
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low, nominal, high, vary high, extra high) 

• Factors Include: 

— Required software reliability (RELY) 

— Database size (DATA) 

— Software product complexity (CPLX) 

Execution time constraint (TIME) 

— Main storage constraint (STOR) 

— Virtual machine volatility (VIRT) 

Computer turnaround time (TURN) 

— Analyst capability (ACAP) 

— Applications experience (AEXP) 

— Programmer capability (PCAP) 

— Virtual machine experience (VEXP) 

— Programming language experience (LtAr) 

Modem programming practices (MODP) 

Use of software tools (TOOL) 

— Schedule constraint (SCED) 

• COCOMO factors encoded with a lookup table to relate 
qualitative and quantltatlv# values 
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the model. Figure 26 shows various ways that derived productivity parameters may be 
presented to the user. 



• Amount of reuse is 
specified on 3 levels 

— Integration 

— Design 

— Code 

• Reuse percentages are 
combined using a 
heuristic relationship 

• Reuse and SLOCS are 
specified on a 

CSCI level 



Figure 25. Autotrade Permits Uncertain Size Estimates for Each CSCI to be Used for Derivation of 

Productivity Parameters. 
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Figure 26. CSO Productivity Measures May Be Analyzed From Several Perspectives. 


5.4.2.6.4 Autonomy Levels Definition 

Autonomy level definitions, derived under Rockwell IR&D fluids, specify system 
capabilities to various degrees of sophistication [7}. These levels range from op^l<>op 
systems to totally self-sufficient systems. The levels, originally targeted 
live been extended to include ground segment functionality as well A^ignn^t of these 
capabilities is per CSO. The specification of autonomy levels is a means for descnbing 
sophistication and complexity of the software domain for the system capabihti« as a wh^le. 
These levels can be used to perform sensitivity analyses on cost versus 
capability encourages cost/benefit analysis for the software in a space system. Figure 27 
depicts L graphical element in the model along with the summaiy autonomy level 
definition per ground segment function. 



Rockwell International Space Systems Division 


Page 61 





Automation life-cycle Coat Model (ALCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


Final Technical Report 



Figure 27. Specification of Autonomy Level per CSCI Supports Software CostjBenefit Analysis for 

Space Systems. 


S.4.2.6.5 CSCI Identification 

CSCIs are uniquely identified and defined within Autotrade by assigning qualitative values 
to each of the COCOMO cost drivers and specifying the autonomy levels to be investigated. 
Figure 28 provides a graphical view of these capabilities. The cost driver values are entered 
as a qualitative value and Autotrade converts it to a numeric equivalent for use in 
COCOMO equations. Figure 29 shows the cost factors presented in a format that allows quick 
comparison of the relative values. COCOMO equations generate summary cost and duration 
values per each CSCI identified in the model. 
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Figure 28. Cost Driver Values Are Specified For Each CSCI Permitting Detailed Analysis of the 
6 Envisioned System. 
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Figure 29. COCOMO Cost Factors May be Examined With Their Assigned Values per Autonomy Level 
and In Rank Order to Obtain Their Relative Importance. 

5.4.2.6.6 Summary Analysis 

Autotrade provides a summary analysis capability. Total software cost and productivity 
measures are presented for each level of sophistication envisioned by the user. This 
capability provides a top-level cost/benefit analysis without investigating the detail of the 
model. Of course, users are free to examine all levels of detail in the model at their leisure. 
The breadth of analysis can be manipulated from the top level, as well, by varying the 
autonomy levels to be investigated. Figure 30 provides a graphical representation of the 
summary analysis capabilities provided by Autotrade. 
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Figure 30. Summary Trade-off Analysis is Supported by Presenting Costs and Productivity Measures 

Over a Range of Autonomy Levels. 


5.4.Z.6.7 Autotrade Summary 

Autotrade is a software cost environment, developed using Rockwell IR&D funds, that 
generates cost, duration, and productivity measures based on the COCOMO model. It 
expands upon the industry de facto model by adding the elements of autonomy levels, 
probability and sensitivity analysis. It is a highly interactive environment capable of 
handling uncertain input values and examining a range of sophistication levels. These 
capabilities encourage its use early in programs where there is a high degree of uncertainty 
within the problem domain both for estimates and system capabilities. 

Autotrade is a valuable stand-alone model for costing space system software for ground and 
space segments. The ALCM framework allows it as an add-on module for sophisticated - 
software costing of an entire system life-cycle. Its interactive environment is the same as the 
ALCM framework itself. As such, it shares the benefits of ALCM: ease of use, interactive 
dialogs promoting iterative refinement of cost estimates, and graphical representation of 
answers to aid complex problem domain understanding. Autotrade was easily integrated 
into the ALCM framework during this contractual effort 

5.43 Framework Capabilities Summary 

The ALCM framework prototype has met its objectives as presented in the Objectives 
(Section 3). The Framework Overview (Section 5.4.1) presented the near-term objectives in 
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the context of the framework implementation. The subsequent sections provided a road 
map of the capabilities within the prototype. 

The following table (Table 20) provides a compact review of objectives satisfaction within 
the context of the prototype implementation. 


Objectives 

— Prototype Features 

Risk analysis 

Temporal representation 
Integrated documentation 

Multiple fidelity levels 

General capabilities 

Uncertain variables allowed on engineering 
estimates for automation implementation and 
potential 

Cost accounting and analysis options partitioned 
by life-cycle phase 

Each model object has an attached documentation 
card that may indude description, background, 
source, legacy, and explanation 
Models are amenable to decomposition to the 
lowest practical and required level of detail 

Spreadsheet paradigm 
Graphics (histogram, line charts) 
Model structure 

Output/display capabilities 

Cost and WBS elements are related through the 

use of matrices 

Model variables and resultant analyses are 
presented as a series of line and bar charts 
The model composition is graphically 
represented using hierarchical influence 
diagrams 

Manual vs. automation 

Comparative analysis 

Explidt accounting of the implementation 
method occurs with unique WBSs. Bottom-line 
analysis yields a single measure-of-merit for 
automation in a particular application 


Table 20. The ALCM Framework Prototype Has Met the Program's Objectives. 


6. Model Validation 


6.1, Overview 

Model validation for LCC models is a difficult problem. Projections for new programs are 
theoretically impossible to prove since the events have yet to occur. Complete model 
validation occurs only after the fact. Models executed in parallel with on-going programs 
are constantly being tested. However, getting to the point of being trusted again brings in the 
question of validation. How then, does one validate (i.e., gain a high level of confidence) an 

LCC model? 

Our approach is to provide a plan, developed with NASA concurrence, that balances the 
desired; or required, level of confidence in the model solutions to the tune and fiscal 
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• Construct Validation — This level provides the lowest level of validation and a 

c^wndine increase in the confidence of results. This level requires that tiie 
variables and algorithms contained in the model appear to be correct 
desktop analysis There is direct relationship among the degree of vahcLtfon 
from this level to the expertise and prestige of the *nodd reviewe^ It b ^ 
intent to use recognized experts within Rockwell and NASA for tius process- 

• Concurrent Validation — This level provides higher degrees of vahdation tha 

Construct Validation and has associated increases in result confidence. TWs 
Dortion of the process compares the results of the model m question to those 
models and date that are deemed to be equivalent. This is simiiar to toting *° * 
"gold standard." The problems that this level generates are the identification of 
the comparable models/date, and the actual need for the model in question if 
other devices are available for use. It could be presupposed that the newer model 
has additional capabilities from the "trusted" modey date. This levd is the goal 
for the demonstration product generated during this contractual effort. 

. Predictive Validation - This level is highest that can be ach i^ m our process. An 
existing model generates, or the date already existe, several jesfcasK for 
comparison to the model in test. The testing standard data Js empirical, itb the 
result of actual program execution and associated costs. Autotrad 
vahdation type .Severalanalogous programs were used as a basis for the 
c ali bration coefficients. 


SJ2. Sample Scenario 

The tile re-waterproofing application provides the scenario to demonstrate ALCM 
fc^eworiT preSype cajLbihties. Detailed modelling for the mobil base platform and 
manipulator system increases model confidence. The application provi es ej i>PP^ ty 

to nrovide rroof-of-concept prototype examples. These capabilitiese include tu » aK * lc ^ 
m<Jdel construction, use and comparison of estimation methodologies, temporal mode g 
aspects, and detailed model documentation. 

Section 5 3 provides a narrative of the engineering system, section 5.4 contains several 
"screens" of the prototype while Appendix 9.3 includes rudimentary user notes. 


7. Comments and Conclusions 


Th» ALCM contract is progressing within the deBned scope and funds established. Appendix 
^«n^ wSnent proVanu^ac information. This report incorporate »mmente 
L«S^^gg«tfons 8 ?cm Technical Interchange Meetings #1 and *Z Appends 9.1 
2nd 92 contain copies of the briefing material for reference purposes. 
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An operations concept has been developed for the Automation Life-cycle Cost Model. This 
includes far- and near-tenn objectives. This report documents envisioned operational 
modes, user options, development phases, proposed products, and advanced technology 
plans. These topics were discussed during TIM #1. 

An ALCM exists based on previous modelling efforts, known and obtainable data sources, 
and advanced technology impact determination. Development steps include architecture 
definition, reuse of existing models, DEMOS plan definition, and friendly user interface 
creation. This framework prototype was demonstrated during TIM #2. 

An ALCM framework prototype exists. It capitalizes upon the robust DEMOS development 
environment including such features as hierarchical model decomposition, key parameter 
definition, historical data injection, and probabilistic model development. The 
implementation includes cost drivers and their relationships within the life— cycle. A 
friendly user interface provides access to probabilistic models, and table-driven and 
constant parameters. A robotic application scenario executes within the framework 
prototype. 

DEMOS is an existing capability within Rockwell. Not only is the tool gaining widespread 
acceptance, training courses are springing up throughout the Corporation. The Rockwell 
Palo Alto Laboratory (RPAL) is promoting and assisting other Divisions in its use. RPAL is an 
active participate on this contract 

Table 21 contains the major comments and conclusions generated during this contractual 
effort. 


• All phases of a system's lifetime must be examined to accurately determine life-cycle costs and 

potentials cost savings with the application of AAR. 

• Examination of the all components within a space system supports Design to Life-cycle Cost 

(DTLCC) goals. 

• A standardized approach to life-cycle cost models is possible with the use of accepted life-cycle 

phase definitions. 

• Program-specific work breakdown structures provide flexible and powerful mechanisms for 

costing space systems potentially using AAR. 

• Providing a variety of cost estimation methods improves model results and encourages analyst 

usage. 

• A friendly user interface encourages iterative refinement of the life-cycle cost model providing 

improved results and increased confidence in those results. 

• The ALCM framework is extensible with specialized modules as shown by the indusion of the 

Autotrade software costing model. 

• Dedsion analysis capabilities provide unique opportunities for review of life-cyde cost trade- 

offs. 


Table 21. The ALCM Framework Examines the Entire System life-cycle to Maximize Cost Savings 

Potential. 


Page 68 


Rockwell International Space Systems Division 



Final Technical Report 


Automation Life-cycle Cost Model (AlCM) 
NASA Ames Research Center 
Contract #: NAS2-13419 


7.1 Suggested Improvements to the ALCM 


First it should be stated that the technical objjtives that we are pursuing, regarding the 
development of this cost model, are four-fold. 
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• Improve tools for managing cost estimation libraries. 

• Provide training materials for ALCM users including tutorials, on-line model explanation, 
guides for model extension, interpretation, and analysis. 

Currently, the model treats the system and its inherent description independent of one 
another. A user cannot explicitly "see" alternative system descriptions and their impacts on 
costs, because the model currently deals only with "quantities" associated with a given 
system, not its descriptors. For instance, selecting titanium as an alternative material to 
aluminum is easily understood by a user, but the current model only depicts change 
numbers and the user does not necessarily know that titanium was selected over the 
aluminum. By including the system hardware description as a part of the model definition, 
a user will have clear visibility into what elements of a system are driving costs. Providing 
these system descriptors, as well as a characterization of the data fidelity and history, at the 
variable definition level (Figure 31) will allow a user to "browse" through the model to see 
exactly what the system is, how it is defined, and how it is being modeled. 




Figure 31. Sample ALCM Object Definition Window With Provisions For System Descriptions and Data 

Legacy/Fidelity. 

In a parametric, or top-down analysis approach, several cost elements are factored from the 
TFU. Again, it will not be explicitly clear to the user what exactly is driving costs, because 
presently our model requires that the user calculate the TFU cost off-line. The model 
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appropriate levels of the hardware indenture, as depicted In Figure 32. 
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model possessing this kind of capability allows a user to assess, in real-time, the validity of 
his parametric estimates as he obtains the bottom-up data. 



Figure 33. ALCM Model Will Perform Simultaneous Bottom-Up and Top-Down Cost Analysis and 

Assess Validity of Parametric Relationships. 


NASA and DoD recognize different levels of automation (and robotics) and different levels 
of technology maturity. Presently, in the assessment of an automated mode, the model 
treats automation as only a single point scalar. This value can be changed to reflect varying 
levels of automation, but it must be calculated off-line. The model should possess a feature 
that would allow a user to assess various levels of automation (and technology maturity) 
for each hardware element of the automated option. This could be easily accomplished by 
adding a table/list of fixed options, and then calculate costs according to a determined 
algorithm relating level of automation, technology factors, level of complexity, etc. This 
capability is present, however, in the separable module Autotrade. The integration of this 
model within the ALCM framework has been investigated and can be accomplished with 
minimal risk. Autotrade is a proof-of-concept prototype for this feature. 

7J2 Follow-on ALCM Effort Statement of Work 

This effort's scope definition, implementation, and validation of a life-cycle cost model 
tailored to examining manual and automation method options for space systems. The 
follow-on effort to the Automation Life-cycle Cost Model (ALCM) encourages an iterative 
tool development. This involves the partitioning of effort into at least 3 separate 
development cycles. Each cycle contains requirement definition, design, prototyping, system 
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Subtask 23. Create Access To Data 

This subtask is responsible for allowing use of identified data within the ALCM framework. 
The data may be pre-existing or generated by a modelling capability. The data need not 
reside within the ALCM framework itself but, at a minimum, be accessible to it 

Subtask 23.1. Integrate Database Query Mechanism 
This subtask involves the alteration of the ALCM framework (and possibly DEMOS) to 
accommodate the query mechanisms of the native database controlling the desired data. 
This integration effort results in a seamless environment for the user to access and 
manipulate pertinent data. 

Subtask 233. Populate Internal Database 
This subtask involves the use of database capabilities within the ALCM framework. 
Identified data populates this database. The ALCM framework provides data access 
mechanisms without reliance on external database modules. Manipulation of existing data 
to fit within existing ALCM (and DEMOS) constraints is within the scope of this task. 

Task 3. Graphical User Interface Refinement 

Graphical user interface (GUI) refinement accommodates changes in the operational 
environment originally envisioned for the ALCM. The Phase I effort identified new 
elements. Changes encountered during Phase II will be addressed and evaluated as they 
occur. 


Subtask 3.1. Identify Graphical User Interface Requirements 
The first step for refining the GUI is the identification of requirements. These may include 
new items generated during the Phase I effort and extensions required for the incorporation 
of models and data. 

Subtask 3.11. New Requirements 

New requirements may impose changes on the existing ALCM framework prototype. These 
requirements may have already been identified during the Phase I effort (e.g., system 
descriptors). 

Sub task 3.12. Accommodate Extensions to Models and Data 
The use of new models and data within the ALCM framework may create GUI requirements. 
Requirement consideration, on a case-by-case basis, includes the extent of changes to the 
existing system, system utility after the extension, and ease of change to the existing 
framework. 

Subtask 33. Design Graphical User Interface Improvements 
GUI design includes consideration for the identified requirements, computing platform and 
environment, and long-term objectives for the ALCM. The design capitalizes on the existing 
ALCM framework prototype capabilities. Minimization of major changes to the existing 
ALCM (and underlying DEMOS environment) reduce risk and contract cost. Full use of 
DEMOS capabilities provides a consistent and mature software system. 
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Subtask 4.4. Create Common Materials Cost Estimating Relationship Table 
Material type and weight are typically the basis of component CERs for space system costing. 
The availability of a table relating common materials used in space systems to accepted CERs 
enhances cost model performance. This is the start of providing cost analysis tools within 
the ALCM framework. This is a far-term objective of the ALCM. This subtask may use and 
integrate existing data. This capability affects Task 2 (Data Usage). 

Subtask 4.5. Extend Autonomy/Automation Levels Capability Throughout 
Model 

A far-term objective of the ALCM is to provide the ability for sensitivity analysis of the 
amount of automation provided within a space system. The Phase I prototype supports a 
discrete function for the hardware specification of a system. The software cost modelling 
partition permits the identification and analysis of several levels of automation. This 
subtask provides a consistent interface to this capability. 

Subtask 4.6 Extend Software Cost Modelling Capability 
The Phase I prototype contains a separable software costing module based on the COCOMO 
model Phase II efforts fully integrate this module into the ALCM framework. System 
enhancements include additional modelling capabilities of COCOMO. The additions may 
include, but are not limited to, use of the detailed COCOMO model, implementation 
language sensitivities, and calibration features. 

Task 5. Cost Estimating Relationship Creation 

The scope of the Phase I effort permitted the limited generation of Cost Estimating 
Relationships (CERs) to support the execution of a demonstration costing scenario. Phase I 
also identified pertinent CERs as well as the need for additional relationships. This task 
expands on the Phase I effort to generate a library of CERs applicable to automated and 
manual space systems through the identification and creation of applicable equations. 

Subtask 5.L Generate Automation Cost Estimating Relationships for 
Specified Application(s) 

This subtask creates CERs pertaining to automation as applied to space systems. 

Identification of terrestrial applications and their extrapolation to space and non-terrestrial 
domains is in the scope of this subtask. This subtask requires analysis of existing data within 
and outside Rockwell International and NASA. 

Subtask 5^. Generate Robotics Cost Estimating Relationships for Specified 
Application^) 

This subtask creates CERs pertaining to robotics as applied to space systems. Identification of 
terrestrial applications and their extrapolation to space and non-terrestrial domains is in 
the scope of this subtask. This subtask requires analysis of existing data within and outside 
Rockwell International and NASA. 
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Subtask 53. Generate Manual Cost Estimating Relationships for Specified 
Application(s) 

This subtask creates CERs pertaining to manual methods as applied to space systems. 
Identification of terrestrial applications and their extrapolation to space and non-terrestrial 
domains is in the scope of this subtask. This subtask requires analysis of existing data within 
and outside Rockwell International and NASA. 

Task 6. Scenario Management 

A system description and associated set of cost data and relationships constitute a scenario. 
This task generates, executes, and analyzes scenarios within the ALCM framework 
environment. Rockwell International may generate or NASA may provide these scenarios. 

Subtask 6.1. Scenario Generation 

Scenario generation consists of the identification of a space system configuration and 
selection of various data and relationships. This subtask's accomplishments include 
documentation and unique identification of this data set. This subtask is responsible for the 
maintenance of the scenario set used in the ALCM. 

Subtask 63. Scenario Execution 

Transformation of a scenario into an executable form and the execution of the ALCM 
framework prototype on the data constitutes a scenario execution. This subtask requires 
documentation of a scenario and associated ALCM results. 

Subtask 63. Scenario Analysis 

Examination of scenario execution documentation and provision of results' synopsis 
comprise scenario analysis. This subtask provides interpretation of data validity and 
sensitivity. The analysis results are appended to, and maintained with, the previous 
scenario documentation. 

Task 7. Report Generation 

Report generation is at least once per development cycle in the form of working papers. 
These reports contain all pertinent information generated and documented by Rockwell 
International in support of this contract The draft final report is in contractor format and 
contains the cumulative documentation from the interim reports to date. The final report, 
whose basis is the draft final report, incorporates questions, comments, and suggestions 
resulting from NASA review of the draft 

Task 8. ALCM Software 

Rockwell International provides software comprising the ALCM to NASA that is capable of 
operating on a Macintosh II computer. 

Task 9. Technical Interchange Meetings 

Rockwell International supports NASA with the preparation and attendance of one 
Technical Interchange Meeting (TIM) per development cycle. At least one TIM will be 
conducted at Rockwell International's Space Systems Division (Seal Beach, CA facility). At 
least one TIM will be conducted at NASA ARC (Sunnyvale, CA). 
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Problems with conventional 
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demonstrated in the ALCM 
Framework 
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Issues for a possible 
follow-on project 

• Integration of ALCM modeling framework with 
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9.3. ALCM Tool User Notes 


Rockwell International Space Systems Division 



Automation Life Cycle Cost Model for the Space Station and Space Shuttle: 

User's Manual 


The key product of the NASA-Ames "Automation Life Cycle Model" contract with Rockwell 
Space Systems Division (SSD), is a Demos model, ALCM. This model was developed at Rock- 
well Palo Alto Lab (RPAL) and SSD to analyze life cycle cost and benefit of automation, as 
applied to a particular Space Shuttle ground-based task. Tile Waterproofing. The model 
demonstrates an integrated cost analysis tool, to support system design, project management, and 
risk analysis. In these days of scarce resources for aerospace projects, integrated treatment of these 
issues is increasingly seen as critical at NASA as well as DOD. 

The ALCM model is implemented in Demos (Decision Modeling System) which is a general mod- 
eling environment for uncertain quantitative models. Demos runs on Macintosh computers, and 
was developed at Carnegie Mellon University. The ALCM model is illustrated by applying it to a 
specific task, waterproofing the Space Shuttle tiles between launches. The current technique for 
waterproofing tiles between shuttle launches is both risk and labor intensive. It requires injection of 
a highly toxic chemical into each tile by hand by a technician dressed in protective suiting while 
standing on a ladder. For safety, the operation can be carried on only during third shift. SSD is 
developing a robotic rover-based system to automatically locate each tile, and to apply the 
waterproofing substance. This operation can occur at anytime during the shuttle's ground based 
period, since the robot end-effector contains and quantifies the amount of the substance absorbed 
by each tile, and can meter the success of each application. While the initial R&D costs for the 
automated system exceed those for the manual system, the model suggests reduction in Operation 
-& Support costs will result in significant payback in the lifetime of the automated system. 

The ALCM was developed to compare the overall costs of the automated and the manual methods, 
over the major three phases of a project (R&D, I&A, O&S). The model includes a standard Work 
Breakdown Structure, the major phases with detailed cost elements for each jshase, both top-down 
and bottom-up costing techniques, including Cost Estimating Relationships obtained from analysis 
of past projects, and the effect of schedule delays on overall costs. The model includes software 
cost analysis based on a DEMOS version of the COCOMO model, an industry standard. 

Purpose of this Document 

This document provides the user with the ability to navigate and explore the Tile WaterProofing 
model without requiring detailed knowledge of Demos. It is meant to be used in parallel with exe- 





cution of the model on a Macintosh. It will support the user in understanding and demonstrating 
this model as a framework for Life Cycle Costing. It navigates through each of the major submod- 
els of the main model, providing detail on specific nodes and their values. While the model runs on 
any Mac n, it is most effective for viewing on at least a 19" monitor. Demos will, however, relo- 
cate the windows appropriately for any size screen, including a PowerBook. 

General Background for running the LifeCycleCost Model 

There are several types of windows displayed within DEMOS, including the diagram, object, and 
value windows. The diagram window shows the overall relationships of objects, or nodes. These 
nodes include chance variables (rounded rectangles) which may be assigned probabilistic input val- 
ues, decision variables (rectangles) over which the modeler has control, and submodels (dark out- 
lined rounded rectangles) which allow the modeler to build his model in a hierarchical manner, 
with varying degrees of detail shown as appropriate. Arrows indicate the "influence" of one node 
on another. The top level diagram window is displayed when the model is opened; submodels may 
be displayed by double-clicking on the submodel node. For each object (i.e. node or diagram) 
there is an associated object window. The object window is accessed by double-clicking on a 
node, or by highlighting the node and selecting the object window icon from the left menu of the 
diagram window. The object window contains all attributes of the object, such as its class, variable 
name, title as it is displayed on the node in the diagram, description including any assumptions or 
qualifications, definition or relationship of this object to other objects which influence its value, 
and a list of any input and output variables. The user can request display of the variable's values as 
a table or graph format by clicking on view buttons in an object or diagram window, to produce 
what is known in this document as the value window. The value window displays the current 
value of the variable. Examples of all these windows are included in the following documentation. 


It should be noted that the attribute pane of the diagram windows should be kept open while run- 
ning this model. This can display an attribute, such as description, definition, or value of a selected 
node. It is opened by clicking on the mailbox flag in the lower left comer of a diagram window. 

While representatives of all the submodels are expanded in this document, the greatest level of de- 
tail on how to navigate and evaluate the model is provided with the toplevel model and the first 
submodel. Tile WaterProofing Manual. Subsequent models will be expanded primarily with re- 
spect to their purpose in Life Cycle Costing, with fewer navigation details. 


2 



Diagram • Rutomotion Options TileiUolerproofin^ 


A 
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= T i ^^7tatlon ▼ I of Automation Cfrtlona TBeW terproolIng: 
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development) automated method for waterproofing shuttle ties bew^ 11^ me user may romp* 
the two methods. It also alows the user to determine the effect of schedule ups. 

The Cost Analy sis submodel performs catenations to determhe the total cost per phase, total cost per morfale, and tot* c«t_ 

Figure 1: The top level diagram. 


nils diagram is displayed on initial startup of the model (initiated by double clicking on the file 
ALCM) It indicates the comparison of the Manual and the Automated techniques by performance 
of Cost Analysis over the life cycle of the projects. The Manual. Automated, and Cost Analysis 
nodes am all submodels, and can be displayed by double-clicking on them; they are expanded on 
subsequent pages of this document. In addition, the Rate submodel includes the information nec- 
essary to convert labor hours to dollar amounts, and the Effect of Schedule Delays expands to 
show the effect of riming delays on the overall costs of the project The decision variable is Auto- 
maton Option, i,e„ whether to automate or not. Hie value variable, or objective, is the Value of 
Automation, which when displayed indicates the dollar amount that automation is expected to 
save over the manual technique. The object window for any node in the diagram window may be 
displayed by clicking on the object window icon on the left of the diagram window. The value of 
variables can be displayed by highlighting the variable's node, clicking on the right arrow from the 
icon menu to select the type of display, and clicking on the view icon to initiate the display. 

The user should note the attribute pane displayed at the bottom of the diagram; since no specific 
node is currently highlighted, the description is that of the overall diagram. The contents of the 
pane may vary, by user choice. By clicking on the button Description, a set of other options is dts- 
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played, any of which may be selected. These options include all the attributes of the object current- 
ly selected, such as definition, name, class, etc. This attribute pane is very useful in navigating the 
model as it provides parallel descriptions of the elements of the model; it is opened by clicking 
once on the mailbox flag icon in the lower left of the diagram window. 

Each of the submodels are expanded in subsequent pages. The highest level of detail on navigation, 
definition, and value display is incorporated in the first submodel, Tile WaterProofing, Manual 
Submodel. Subsequent submodels are described more with respect to their purpose and the rela- 
tionships of their nodes. 
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Fi Jure 2- Expansion of the Manual submodel to indicate the 
F E Tostsof P the manual option for Tile Waterpmofing. 


This diagram/submodel is dis- 
played by double-clicking on the 
Tile WaterProofing Manual sub- 
model of the top level diagram. 
It is at the second level of the hi- 
erarchy as shown by the hierar- 
chy expansion icon at the top, 
second icon from the left. This 
indication of hierarchy is pre- 
sented if the user has chosen 
Show Model Hierarchy in the 
preferences dialog of the edit 
menu. 


TOs model provides entry of dam in a bottom up method, where the modeler enters values for actu- 
“Ximl cosir each of the three major phases of the manual imp— , n c if the 
project It should be noted that the detailed cost elements of each phase are tdenttca 

projects, providing a consistent interface to the user. The ^^^^^^"p^^^Msllues 
for the project by defining the values for Operattonal years and Fl.ghts per year. 

impact the O&S phase costs of the project, 
as shown in figure 3 below. 

AS previously stated, this window documents al, the “ ble 

tiUe. description, defmition. and input andoutpu. vanable, . Tte * Table 

The edit table is shown in figure 4. 
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Title: jRSiDFtase Cost* 

{Manual 

Description: AJ Itesearch fc Development (rid) cost* for for each cost element of 
the r4d phase of the Vbnual project. 

It is possible that some cost-elements wl be ^appropriate, and wa be 
$et to 0. 

E ▼ 

Definition: [ Edit Table ) indexed by W.D Riase CostSements 
kiputs: £7 M_costel... RtD Phase GostBements 
RfcP ? Manual ▼ | 


Outputs: 



Variable type, 
’name, and units. 

Variable title, used 
as diagram labels. 

__Description, used to 
document relationships 
and assumptions. 

Definition; may be a list 
an expression, or a table 

Input and output vari- 
ables; may be used for 
navigation. 


Figure 3: Object Window for node titled 
R&D Phase Costs, Manual 


As previously stated, this object window documents all the attributes of the object, including its 
name, title, description, definition, and input and output variables. The actual values entered for 
the table definition may be viewed by selecting the "crossbar” icon, or may be modified by clicking 
on the Edit Table button of the definition. All the fields in the object window are either editable or 
are used as navigation aids. Input or Output variables, when selected, will display that variable's 
object window. The edit table is shown in figure 4. 




Edit Table • R&D Phase Costs Manual (labor fr capital units) 

[ Choose hdlce* j 

(Accept] [iteverT] 


T\ 


| MD Phase GwtElements ▼ j 


$ 




Development Eng (labor) 

550 

ProducibilitY En^l* Plan (labor) 

275 

Tooling {capital) 

0.46 

Prototype Manufacturing (capital)^ 

6.88 

Data (labor) 

800 

System Test 1 Evsl (labor) 

6000 

3y*rm/Pro1 Mgmt (labor) 

10K 

TraMng (labor) 

40 

Facilities (capital) 

0 

Software Qatar) 

0 

Other (labor) 

0 


Figure 4: Input table for Manual R&D Costs, Bottom Up 


This value window is accessed 
by clicking on the Edit Table but- 
ton in the description of the node 
R&D Phase Costs, Manual; this 
button is found in the object win- 
dow and in the attribute pane if 
Definition is selected. 

For each cost element (Develop- 
ment Engineering etc) the model- 
er enters the appropriate value 
for either labor hours or capital 
dollars, in the bottom up ap- 
proach to costing. 
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(Tile. Waterproofing. Manual Submodel, continued) 

As shown in the diagram window, figure 2, these values are then operated upon by the appropriate 
rate vector, and are summed with values from the other phases to determine the overall costs of the 
Manual project. These table entries may be entered as probabilistic or deterministic. To enter a 
probabilistic value, the modeler may type the distribution and its parameters directly into a table 
cell, or may select a template from the library menu, as shown for the definition of Operational 
years in figure 5 below. This use of a template from the library is to define a probabilistic func- 
tion, but the modeler may select from a variety of existing function libraries to define variables. 

These function libraries in- 
clude standard math, specific 
array functions, probabilistic, 
logical and other functions. 
The modeler selects a function 
template, which is inserted in 
his definition field; he must 
then correctly define the spe- 
cific names of the input vari- 
ables to the function. 


At this point in this document, 
the user has been provided in- 
formation on how to browse through diagrams and nodes, how to access the attributes of a node 
(object window or attribute pane), and how to enter values or definitions for variables. The user 
must also have the knowledge to access value windows within a diagram, and possibly to display 
the values in various modes. The value of the total manual cost of the project, organized by phase, 
is shown in figure 6 below. 

The three windows of figure 6 indicate the value calculated for the Manual implementation of Tile 
WaterProofing, over the three major phases of the project. The first window is displayed when the 
user chooses the crossbar icon from either the diagram window (if the Manual Cost by phase 
node is selected) or clicks on the crossbar icon from the object window for the Manual Cost by 
phase node. This default window presents the data deterministically and graphically. [For a deter- 
ministic display, all probabilistic input variables are assigned their midvalue prior to performing 
the calculation of the specific variable’s value; this provides a rapid calculation of the value, which 
may be refined to fully probabilistic if the user prefers.] 


r 4 rite Edit Object 6raph] 


3HZBW jjjgfwn Ujlndoui 
Math F"[ 

Arrau ► 


m 


Object 


Special 
Statistical ► 

Operators ► 

System Portables ► 
• Operational years 


Operations 
Title: Operational 


Unite: Yaefi 


Chancedis t (Array l,Arrayt{, Indent)) 
Cumdist(Arrayt{, Indent}) 
froctlles(Arrayt) 
LoqnorroaKPosltlue, Positive) 


Noi m«iH Si dlai ,Po vittue i 


Probd!st(Arreyt(,lndeMt>) 
UnlforrotScalar, Scalar) 


Dane rattan: Hmtmr of ymn expected ter ti* tystam to be muse. 
Definition: nofm«J(25,1) 


Output*: [ Total wuefcer af Asht» T I 


Figure 5: Using a template from the library 
to define a variable; in this case, the function is probabilistic. 
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The user may then choose a tabular display of the same data ixrttom win- 

their contents appropriately. 

»>' ^ht mangle icon, and choosing tan I ^ or deterministic . The ,op 

Function, or Cumulative Density Func . . e _ hases 0 f Manual costs; 

right window in figure 6 shows the probabilistic c ™ ^on d variable, as indicated 

in this case, both R&D and I&A are single valued, but O&S is a probab 

by the spread of its Probability Density Function (PDF). 

— •ssss. 

mation will be included. The su m . which is the submodel with the 

of Schedule Delay, and finally TileWaterProofing, Automated, which is the 

highest level of complexity. 
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Figure 7: The Rate submodel, 
defining conversion vectors for all phases. 


This submodel is accessed by double-clicking 
on the Rate node in the toplevel model. It pro- 
vides a level of abstraction, where the modeler 
can separately define labor rates that will ef- 
fect multiple segments of the overall project. 

The variables defined in this model effect cal- 
culations in both the Manual and Automated 
submodel calculations, since they define the 
conversion rates from labor hours to Kdollars. 
For each cost element per phase, a conversion 
factor is defined. At this time, only two fac- 
tors are utilized; however, the number and level of granularity is dependent only on the modeler. 

The cost elements vector for the R&D phase was shown in figure 4, above. In figure 8 below, the 
cost elements vectors for the other two phases are displayed. For O&S, the format is that of an 
entry table (accessed by clicking on the Edit Table button of the O&S Rate Vector definition), 
where the modeler has specified the use of Labor rate as the conversion factor for a small subset 
of the cost elements, with Capital rate as the primary conversion factor. Since capital values are 
entered directly in the Manual and Automated submodels as dollars amounts, no real conversion is 
required. However, the structure is maintained to indicate the flexibility of the Rate submodel. 
The value window is displayed for the I&A rate vector, to indicate the evaluated values of the as- 
signed labor and capital rates within the vector. 
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Cost Analysis Submodel: 

This model is accessed by double-clicking on the Cost Analysis node of the toplevel model. Its 
purpose is to combine the costs determined in the Manual and A utomated submodels, and to allow 

the user to view these values 
from multiple perspectives. The 
difference value is used as out- 
put to define the overall value 
variable of the toplevel model. 
Total Automated Costs are 
used as the basis of calculations 
in the Effect of Schedule De- 
lays submodel. 





Description ▼ | of Cost reduction for outoi'n By 


Offer once between eutometed l manuel, by major pha*e; negative Wcate* that manual b Q 
cheaper than automate, poaithe binverae. 


Figure 9: The submodel for Cost Analysis, 
providing different perspectives on costs. 


As indicated in figure 9, costs 
are derived from those overall 
costs determined per phase in 
the Manual and Automated sub- 
models, and may be displayed in 
conjunction, or by technique (Manual or Automated), or as the difference between the two tech- 
niques. 


v J 


Mid Uolue • Cost reduction for outom'n By Phase (SIC) 




X A)d»: [ Major Phase* ▼) 




Major Phaata 1 

m 


Figure 10: Automation costs are higher than manual in 
R&D and I&A phases, 
but provide cost savings in O&S phase. 


Figure 10 displays the final value 
calculated in this submodel, the 
difference between Manual and 
Automated costs for each phase. 

While it is displayed in graphical 
deterministic format, it could be 
displayed in tabular form. If 
there are any probabilistic vari- 
ables, it may be displayed in 
probabilistic mode as well. 
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F.ffect Of Schedule Delays Submodel! 

This submodel, accessed by double-clicking on the Effect Of Schedule Delay node of the toplevel 
diagram, determines the effect of a delay applied to the overall assigned schedule of tasks, explicit- 
ly with respect to the Automation project. While it could be expanded to include assignments of 
different delays to various parts of the project, this relatively naive treatment provides proof of the 
concept of dealing with uncertain schedules. 

As indicated in the attribute pane of 
figure 11, this is a timing model, for 
determining the effect of slipping 
the project over time for uncertain 
amounts of time; the user may 
modify the initial timing schedule 
contained in the input node Task 
Timing or he may change the delay 
values in Delay and then may ob- 
serve the effects on Task Cost by 
time which simply shifts the expect- 
ed costs over the available years. Further, he may view the effect on costs of inflation combined 
with the possibly uncertain delays. Figure 11 displays the diagram window; figures 12-14 display 
the values as effected by the delays. 


&| f TasCTT 

EE [ timing j ~* 


(oo«y) 


/ Yeaf »/ 


r Nocm task) I 

timing J j 

f TOTAL } 
Automated 
Costs \ u 

V ■ 

■ * ' 


Delayed task 
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n 
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Figure 1 1 : Determining the effect of uncertain delays 
V on schedule and cost. y 



Figure 12 indicates the schedule 
as initially entered by the mod- 
eler, both in tabular and graphi- 
cal format. The modeler enters 
the hours expected per year per 
phase. These values are then 
normalized, and the delay is ap- 
plied to them, yielding the Task 
cost by time delays. In this 
case, two values were entered 
for Delay by the modeler: 0, 
i.e., no change, and Lognormal 
(1,1.5) indicating a probabilistic 
delay ranging between approxi- 
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“ , and is shifted right in Ute second case. The effect of Marion is .hen taken tn.o account, 
yielding the value windows shown in figure 13. 

As indicated, the dollar 
values for a non-delayed 
project peak near $2000K 
for both R&D and l&A, 
while O&S peaks near 
$1500K. However, appli- 
cation of the second delay 
yields peak values closer 
to $2200K. These displays 
can also be presented in 
probabilistic or tabular 



Figure 13: Effect on each phase, in dollars, 
of no delay and of a delay of ~2 years. 


J 
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Jilr WaterProofing, A utomated Submode l 


This submodel provides the most complexity of all the submodels in the top eve m e . 
tains submodels that utilize bottom-up techniques based on "Theoretical irst mt va ues 
mined from previous projects (see Bottom-Up Cost Calculation submodels EndEffector Nfantpu a- 
tor and MobileBase) as well as top-down techniques using cost est.mat.ng relationships (C s) 
based on analysis of previous projects (see Top-Down Cos. Calculation). In addition, within the 
Bottom-Up submodel, the COCOMO model is incorporated for determining the cost of software 
associated with the WorkcellControUer. This model, an industry standari for calculating software 

costs, has been converted to Demos format. 

This variety of techniques for determining the expected costs of the major phases of a project dem- 
onstrates this LifeCycleCosting model as a framework for assessing and verifying overall project 
costs While these techniques are varied, the framework could be enhanced even further by the in- 
corporation of other costing techniques. I. is expected that other techniques will be incorporated 

during a follow on effort. 

This submodel is accessed by double-clicking on the Tile Wa.erProofing, Automated node of the 

toplevel model. I t indicates that both botlom-up and top-down costing techniques will be used to 
5- — 1 \ determine overall costs of 




Diagram « Til elll a tarf roofing RulomaUd 


/ WBS 1 
/Automated/ 


Bottom-up 
Cost Calculation j 


Automated Cost 
by Phase 


^Bottom-up Cost 
“TFU" 


Top-Down | J CER Cost ) * 

Cost Calculation J v__ 


Compare 
Bottom-Up 
Top-Down Costing 


Figure 15: Determination of overall costs of the Automated 
Project, using several costing techniques (bottom up ^^eoreu- 
cal First Unit calulations and implementation of the COCOMO 
model, top down by Cost Estimating Relationships) 


the Automated technique. 
The theoretical first unit 
(TFU) based calculations 
are then compared with 
the CER calculations. In 
this case, the Automated 
Cost by Phase, as based 
on bottom-up calcula- 
tions, is used by the Cost 
Analysis submodel of the 
toplevel model. 

Details of both submod- 
els, as well as the result- 


tag values are summarized in following sections. For die Bottom-up submodel, only one example 
of die TFU calculations will be shown; it is left to the user to browse the other stmtlar submodels. 
The final costing for the automated technique is included at the end of this document 
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Rnttom-I Jn Cost Calculati o n Submodel of Automated Submptel l 


This submodel, accessed 
by double-clicking on the 
Bottom-Up node in the 
Tile WaterProofing Au- 
tomated submodel, indi- 
cates the separate sub- 
models for each of the 
major components of the 
Automation project. 

These components are 
specified in the top level 
Work Breakdown Struc- 
ture (WBS) for the 
project. Within each of 
the component submod- 
els, there may be further granularity provided for the elements of that component. The calculations 
for the first three components, End-Effector, Manipulator, and MobileBase, are all based on provid- 
ing the bottom-up cost element values per phase as percentages of a Theoretical First Unit, i.e., pro- 
portional values based on an existing project. Since all the calculations and submodels are similar, 
only one will be expanded, as shown in figure 17 below. Cost values from each of the submodels 
are combined to form the overall bottom up cost calculations for the automated technique, as indi- 
cated in the Automated submodel (figure 15). 




V. 


Figure 17: An example of bottom-up costs based on 
Theoretical First Unit costs. 


J 


In figure 17, the bottom-up costing of 
the End-Effector is indicated. The cost 
of both R&D and I&A phases, (using 
the same cost elements as those shown 
in the Manual project and the Rates 
submodel) are based on the modeler de- 
fining both the dollar value of a Theo- 
retical First Unit (TFU) and the per- 
centage for each cost element that 
should be used to determine the overall 
costs. The user may inspect both the 
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jBanamjlB Cast Cakulalian Sub m ^i nf Automated Submodel, wntimied l 

definition for the First Unit Cost and for the assigned percentages, as well as the definition of the 
conversion to dollar values; for example, the R&D$ EE value is determined by applying the per- 
centages assigned to the R&D cost elements to the value of the EE-TFU, using the equation 

Rd_of_tfu*Ee_l st_unit_cost 

This may be observed in the definition option of the attribute pane when the node R&D$ EE is se- 
lected. The user may then navigate to the input variables to verify their definitions. The calcula- 
tions for the O&S phase of the project is based on the same bottom-up technique as defined in the 
Manual project; the modeler enters the actual labor hours and capital costs associated with each 
cost element of the phase. In this submodel, all major phases are then combined into a table by 
summing over the cost elements per phase, and arc output to the Bottom-Up submodel costs of the 
Automated method. The submodels for Manipulator and MobileBase are replicates of this sub- 
model, with the appropriate percentages and TFU values entered. 


The Workcell Controller Costs are for software alone. Hence, the costing for this component of the 
Automated method is based on the Constructive COst MOdel (COCOMO) software costing tech- 
nique. When the WorkcellController submodel is expanded, the costs per phase are based on the 
submodel Software Development Costs, shown in figure 18. 
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Figure 18: The COCOMO technique for software costing. This submodel includes an 
6 ' Uncertainty Analysis component. J 
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As indicated, all values to be entered by the modeler are contained in the submodel User De 
Software Values. In this submodel, several tables are defined for indudtng ratings for the 
“pllec, with respect to cost drivers such as required level of reliability and database srae. 
These tables are assigned for each work-breakdown structure element for the Workcell controller, 
in COCOMO terminology, these elements are known as Computer Software Con ^“°" ®' 5 ' 
or CSCIs In the User Defined submodel, the modeler also enters values spectfic to each CSCI 
such as the number of lines of source code (SLOC) of related projects, and the fracnon of m^ima- 
tions (annual change tntffic) expected. The modeler also indicates percentage relanonsh.ps 
known projects and the level of uncertainty for cost drivers. 

Ron, the modeler defined parameters, the expected number of source fines - 
productivity are determined, based on existing projects (see submodel KLtnes Code (SLOC) & 
Levity). The overall development costs are then calculated for each CSCI, over a range of posst- 
ble autonomy levels (see submodel Development Costs Per CSCI). Base bod, on modeler sup- 
plied values and the Development costs, maintenance costs arc then determine or eac • 
again over a range of possible autonomy levels (see submodel Maintenance Costs Per CSC®, fi- 
nally, the overall values for the software costs are defined: the development manhours per hue of 
code and the lifetime cost per CSCI for all autonomy levels. The modeler-chosen spec, c au 
my level is then used to extract the development and maintenance costs that wt provt 
phase costs for the WorkCell Controller submodel. 

While descriptions arc included for all the elements of the COCOMO submodel, the user is referred 
" Software Engineering Economics by B. Boehm for furdter derail on the assumpttons and 

use of the COCOMO model. 

An additional aspect of the COCOMO submodel in the Demos implementation is the : provision .for 
Uncertainty Analysis, also known as Sensitivity Analysis. In essence, this allows the <■* 
termine which uncertain input variables have the greatest impact on the uncerramty ,n a calculated 
variable. This analysis determines, based on both the degree of uncertainty in the input vana es 
arai the influence of its value in die calculation of the variable of interest, die variables whose un- 
certainty have the greatest effect on die uncertainty in tha, variable. This ts useful m 
the set of input variables whose range of values need to be minimized in onier to provt 
tainty in the variable of interest. The submodel and its output are shown in figure 19. 
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aculMian Subm o H fl£ A..tnmated .Submodel. PQntm ui 

TCisUimertaintyAnalysis submodel provides analysis for the effect of uncertain input variables 
on both the Development and Maintenance costs for the specific modeler-chosen autonomy ev 
The associated uncertain variables are the cos. drivers for both development and -—e cal- 
culations. The submodel itself is shown in the upper left. Output, in two formats, are a s 
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Ftaure 19- UnTemtinty Analysis to determine which input variables have primtuy influence on 
v ^teunceSntyin the total costs of development and maintenance, for each CSC1. 

Both csa elements (I/O and Controller software modules) are represented in each output format 
On the left the effect of uncemin cost-driver values on the Development costs am shown grapht- 
cally, indicating that uncertainly in SCED (schedule constraints) has the primary effect on uncer- 
S in the development costs for die VP module, and uncertainty in DATA (database » > has die 
strongest effect on the development costs for the Controller software. On the nght, the tabular for- 
mat is shown for Maintenance, indicating that uncertainty in MODP (modem programming prac 
es) has the most effect on uncertainty in the cost of die VO module, while die Controller cos. unce - 
tainty is most affected by AEXP (application experience). This is most valuable to t e ost na- 
,yst, in evaluating the effort that should be expended in determining further detad about a minimum 

subset of uncertain input variables. 
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Tite WaterProofmg. Autor ^H Submodel. Costs 


□§§ Mid Ualue • Rutomoted Costs By Module, Phase ($K) HBk 
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Finally, on completion of cost cal culation by the bottom-up methods for the Automated technique, 

the final costs are deter- 
mined and may be dis- 
played. As shown, they 
are defined for each of 
the major components of 
the Work Breakdown 
Structure, and are sepa- 
rated into the costs asso- 
ciated with each phase. 

It is these costs, summed 
across the WBS compo- 
nents, that are compared 
with the costs for the 
Manual technique as 
shown in figure 10 of the 
Cost Analysis submodel. 
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Figure 20: The final costs associated with the Automated technique. 


Comparison of a subset of these values with those generated by the top-down method is shown by 
displaying the Compare Bottom-Up Top-Down Costing node, as shown in figure 24. 
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i Diagram • Top-Down Co«t Calculation 1 
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I Library 






o 

32 


Figure 21: Cost Estimating Relationships axe used 
to determine a top-down costing of two of the WBS 
elements. 


•ms submodel is a cost model to detenuine overall costs by using the top-down technique of Cos. 
Estimating Relationships (CERs), based on the requirements, complexity, and technical readiness 

levels of key design parameters for the proposed module s, or elements of the Work Breakdown 

v Structure. Each design parameter 
(accuracy, payload .control type,...) has 
an associated complexity and technolo- 
gy readiness level as well as constraint 
values (amount of weight required, ac- 
curacy of positioning in inches,...). In 
this case, only the Mobile Base and the 
Manipulator systems are presented, to 
show proof of concept of providing 
various costing models within the 
framework of the ALCM. 

As indicated, the submodel Cost by 
V CostEstimating Relationships pro- 

vides the cost of both the mobile base and the manipulator, for comparison to the bottom-up costing 
methods for the Automated technique. An access library is provided to allow easier access to table 

values, and will not be d escribed further here. Th e submodel Cost by CostEstimatmg Relation- 

" ships is shown in figure 22. As indicated, the 
key design parameters for the two modules of 
interest include the common parameters of Pay- 
load, Positioning Accuracy, and Control Type. 
Degrees of Freedom and Reach are only appli- 
cable to the Manipulator system, but are includ- 
ed here for the overall structure. In the table 
CER values, the constraint requirements, com- 
plexity levels, and technology levels are entered 
by the modeler. The cost of each design pa- 
rameter for each WBS is based on the require- 
i ments, the complexity level and the technology 

Figure 22: A framework for specifying the rea diness level, 
combination of possible design parameters 
required for a WBS' costs. 


I IImtiw • Cost fcg CattlitlmiUnq t«litlon«hlp» 
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(Top-Down Cost Calculation Submodel of Automated Submodel, c ontinued 


Figure 23 shows the values as entered for the Manipulator system; also included are calibration 
constants used in the determination of the cost of requirements, for each design metric (key param- 
eter), and a scale value used to convert units, or to neglect any inappropriate key parameters. 
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rigure lx ror eacn woo, mere are Key ucsign paiamcicii, yy do 
F or each metric, there are constraints or requirements, complexity and technology readi- 
ness levels, and calibration and scale values used in the cost calculations. 


There is clearly more detail relating the calculation of total cost from the key parameters. The user 
is urged to browse through the various elements, viewing the description and optionally the defini- 
tion for the various nodes. 
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Figure 24: A comparison of Bottom-Up and Top-Down costing 
for the Mobile Base and Manipulator. 


Figure 24 reverts to the Tile 
WaterProofing, Automated 
submodel, in comparing the 
costs determined by using 
both the bottom-up and top- 
down methods. 

As indicated, the values are 
very close, providing the ana- 
lyst with a strong level of 
confidence in the accuracy of 
both techniques. Viewing 
this data in a tabular format 
indicates a difference of ap- 
proximately 10%. 
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IF b THEN x ELSE y 

For values of b that are true, x Is returned; for values of b that are false, 
y is returned. 
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Confbands ( x ) 

This returns probability or "confidence" bands over x, assumed to be 
uncertain, for probabilities specified In System variable Confidences, 
which by default is 5%, 25%, 50%, 75% and 95% probability. 
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9.5. Qualitative Criteria for Robotics CER Generation 
9.5.1 MOBILE BASE /PLATFORM 

Cost estimation for mobile base/platform costs includes the following four criteria: 


1— Payload Capability 


Platforms with different categories of payload capabilities will vary in 
transmission, brakes (if any), suspension, chassis/frame, material and 


their drive system, 
fabrication. 


1 Drive System— Payload weight increases require higher horsepower systems. This may require 
development If ttmponente tat am not readily available such as gears, racks and 

pinions. 

2. Transmission— Transmission types can vary the system cost greatly. A system could betwo- 
wheel drive, four-wheel drive or each wheel may require an independent drive system. 

3 Brakes — Some systems require an independent brake system to add to the system safety. This 

te^^re important with systems that have higher inertia (function of velocity and 

mass). 

4 Suspension System— A variety of possible suspension systems exists. A suspension system could be 

T,lX?a^cking arm or thTdasign pmvidea each wheel with an independent auspension 
system thereby minimizing the effect of one wheel on the rest of the system. 

5. Chassis/Frame — Normally, as the payload weight increases, the c ^ ss j s ^ s l f 

introduces problems with the design of the chaise and issues such as load distribution to 
minimize bending and deflection, or eliminating any possible stress points to insure long 
operation life. 

6. Material and Fabrication— Higher payload capability will require use ofmatemlsthat offer 

more strength. It is more difficult and costly to use these materials than lowerstrength 
alternatives (i.e., stainless steel 316 vs. aluminum). Furthermore, the larger ^e frame 
becomes, the more difficult it becomes to maintain dimensional tolerances and avoid frame 
warping. This is especially true when welding joins structural elements. In ^any^tances, 
is necessary to design and fabricate special fixtures for this purpose. Therefore, the cost of 
machining and fabrication increases as the payload weight increases. 

2— Positioning Accuracy 

Higher accuracy requires the use of more accurate positioning sensor systems. For gross 
positioning, a simple dead reckoning system could be sufficient. As requirements for 
accuracy increase, the use of sensors such as acoustic sensors, laser range finder, 
identification bar codes placed around the work space for triangulation, or 
become necessary. Design to operate off-road may require GPS use or placement of active 
beacons around the operating range to allow triangulation by the system. 
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3— Control and Navigation 

Control and navigation of the mobile base/platform can fall into the following three 
categories. 


1 Teleoperated/Telepresence — This is when the operator remotely controls the movement of the 
platform. The operator remains in constant control and either through direct wdenM or 
remote sensory data it maintains its knowledge of the platform surroundings and position. 


2 Self Guided— The platform operates along a predefined path and contains equipment to detect 

ta«wn obstacles*! AutomatS Guided Vehicles (ACV) fall into this category. These systems 
typically operate indoors and use identification systems placed along its path. 

3 Intelligent Mobile Base/Platform— The platform is capable of planning its path and operating 

Sown to reach to its commanded destination. Off-road platforms usually use this level of 
automomy. The platform may use a topographic map to calculate its trajectory and . ^ uses 
its highly advanced sensor systems to avoid obstacles. The platform may use a 3-D imag ng 
system to verify its position against the topographic map. The system becomes more 
sophisticated and costly when obstacles are moving objects m a 3-D space. 

4 — Others 

The list below contains other factors that could be important in assessing system costs: 


1 Operation-The development cost of a mobile base/platform for use in a sti^c^red environment, 
P with known obstacles, or its movement can be predefined, is significantly less than a system 
designed to detect and operate around unknown obstacles. 


2 Environmental Condition— There is a substantial increase in the cost of a system designed to 
operate under extreme conditions such as high temperature, high radiation or in a dusty 
pnvironment 


3. Terrain-System design includes a variety of terrain. Cement or asphalt floors or off-road. This 
could also include wet or frozen surfaces. 

9.5.2 MANIPULATOR SYSTEMS 
There are six examination areas for estimating the cost of manipulator arms. 
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1 — Degree of Freedom (DOF) 

The increased DOF escalates the design complexity. Since it is usually desirable to avoid the 
design of a bulky manipulator arm, the packaging of the drive systems becomes a design 
challenge. This becomes more evident when there is a requirement for having a modular 
design to facilitate system maintenance and servicing. Furthermore, it is necessary that 
system singularities do not fall within its work envelope. The higher DOF translates to 
increased system weight, which results in payload capability reduction. Therefore, to 
achieve the same payload capability with increased DOF, employment of more efficient and 
compact motors and drive systems add to system cost. 

2 — Reach 

Increased reach introduces new design issues including: increase in the system weight and 
the dif ficulty in controlling flexible modes to maintain a high level of control. Resolving 
these issues raise the cost significantly. The solution includes the use of more expensive 
materials that offer high stiffness-to-weight ratios with more advanced control algorithms. 

3— Payload Capability 

Higher payload capability results from the use of motors with higher horsepower or by 
reducing manipulator arm linkages and drive system weights. Both of these two options 
translate directly to higher cost. 

4— Positioning Accuracy and Repeatability 

Higher accuracy is a function of mechanical design, sensor systems and control. The next 
section discusses the latter. Higher positioning accuracy requires tighter design tolerances 
where there is no free-play between the elements. This includes, the drive system and all 
the associated geare and tape drive systems (if any). To avoid the cost of fabricating and 
assembling high precision hardware with a long operating life, a design may use a direct 
drive at the joints. This will have its own drawbacks as discussed before (packaging, motor 
size, etc.). Use of a direct drive could help to reduce system hysteresis and/or uncontrolled 
compliance. The use of more advanced sensors with higher resolution and update rates is 
another factor that increases system accuracy along with increasing cost. 


5 — Command & Control 

There is a wide variety of control architectures and algorithms used to control manipulator 
systems. They vary from a simple PID controller to an adaptive and model reference control 
system capable of optimizing system performance. 

Additionally, the interface between man/operator and the machine could also vary 
drastically depending on the requirements. For the most part they are very similar to those 
of the mobUe base (discussed above). The command and control categories contain the 
following five considerations: 
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1. Preprogrammed — This is the most primitive level of interaction between man and robotic 

manipulator arms. Training permits the manipulator arm to perform a task through a senes 
of motions. When the robot is in operation mode, it performs the same task repeatedly. This 
is a very common technique used in assembly line manipulator arms. After training, the robot 
does not interact with the operator and has limited interaction with the surroundings. 


2 Teleoperated/Telepresence — Here, a master arm or a joystick controls the manipulator system, 
referred to as a slave arm. Usually there is a one-to-one correlation between the master arm 
and slave arm degrees of freedom. The position and orientation of each master arm joint are 
detected, multiplied by a factor (gain) and sent as a command to the slave arm. Some of the 
more complicated arms may also detect the force at the slave and feed a portion of that back 
to the master arm and the operator (bilateral force feedback). In the case of a joystick and/or 
a track-ball, the operator flies the end effector. To command the manipulator arm, an averse 
kinematic algorithm calculates each joint position and orientation based on the commanded 
position. 


3. Supervisory Control— Here the manipulator arm is capable of decomposing low level tasks into 
subtasks. The arm then performs these subtasks in an orderly manner. The operator interface 
with the robot will be through higher level commands and the operator will supervise the 
operation with manual control and emergency shut down capabilities. 


4. Coordinated Motion— This involves using more than one manipulator to perform tasks. 

Coordination of manipulator arm motions avoids damage to the work piece and/or thearms. 
For example, when a manipulator arm pulls, the other(s) will give in and vice versa. The 
controller strives to minimize the forces and torques in one or more axis depending on the task 
performed and the controller requirements. This also requires the use of sensors to detect the 
forces and torques in each axis. 


5 Task Based Control— This is the highest level of operator interface. The robot workcell 

controller receives task objectives. The workcell controller decomposes these objectives into 
tasks, subtasks and motions and executes them accordingly based on available resources 
(various manipulator arms, sensors, etc.). In the event a problem arises during task execution, 
the controller can develop a contingent set of subtasks and execute them to work around the 
problem(s). 

6 — Others 

There are other factors such as high velocity requirements or harsh operating 
environments that could impact the system cost. For example, many welding robots require 
their electronics and all the power and data lines shielding to maintain signal integrity and 
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protect them from noise induced by welding apparatus. The cost impact of these types of 
system requirements warrants individual consideration and not explicitly included as part 
of the model However, the means of expressing these factors in the model should be 
present 

9.53 SPECIAL TOOLS (END EFFECTOR) 

End effectors perform a wide range of functions. Depending on the function, they vary in 
the design and cost. In many cases it is the end effector that makes one robot uniquely 
different from others. The same manipulator arm can perform completely different 
functions with different types of end effectors. On the other hand, the robot performs the 
same function with a different work envelope using the same end effector and manipulator 
replacement. Because of the uniqueness of the end effector design requirements, it is very 
difficult to include them in a generalized cost model. We recommend the initial use of the 
following six criteria for estimating end effector cost: 

1 — Handling 

End effectors generally perform a physical function on the work-piece (contact) or 
monitor/inspection (non-contact). They vary in accuracy and load handling capability. 
Usually, the end effector cost increases as the accuracy and load carrying capability increases. 


1. Contact End Effector— The end effector encounters the work-piece and performs a function or 
grasps an object while the manipulator arm moves it from one point to another. Use of the 
most basic end effector, the parallel jaw, includes a variety of applications including PC- 
board assembly and manipulation of objects in assembly lines. Common use also includes power 
tools, such as a screw driver. The cost increases as the tool becomes more specialized. 


2. Non-contact End Effector— Their use includes movement around a sensor system package to 

perform non-destructive testing (NDT) or monitoring an on-going operation. Therefore, they 
carry a fixed mass. Inspection tasks may use a more complicated system to guide a small probe 
into a maze-like system. This may require more system flexibility and degrees of freedom. 

2 — Environment 

The operating environment impacts the end effector more than the rest of the robot. In 
many cases, the end effector is the main element in creating an adverse environment. For 
example in the case of the re-waterproofing tool, the end effector injects DMES, which is not 
only hazardous but reacts to most materials and causes corrosion. A welding end effector is 
another example of an end effector type that falls into this category. The operating 
environment itself is another factor. Some operating environments impose additional 
requirements. For example, a nuclear hot cell uses a hardened end effector and an 
underwater application uses a water resistance or sealed end effector. 
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3— Force/Torque and Micro Positioning Control 

Most manipulator arm overall control schemes include end effector control systems. 

Ho“ e^*ere are ™os. which require their owh closed-loop control system. These are the 
end effectors that offer multiple DOFs. Operations include these end effectors handling 
deUcatectbjectsor as micro positioning systems (the ^waterproofing end 
both these purposes). In each case, the end effector design is more complicated and uses 
more sensors to control forces, torques and positioning accuracy. 

4 — Machine Vision 

Vision systems can be independent of the end effector. However, some applications, such as 
monitoring use'vision as pkrt of the end effector. In either case, it's an important put of 
robotics with wide use by industry. Most currently used vision systems are off-the-shelf and 
operate under a specific environment using a set of standard algorithms. Vision system 
a (tributes delude easy integration and modest cost. Tbe cost of vision systems mcreases for 
unstructured environments. The following applications may use vision systems: 


1. inspection and monitoring-Vision system uses include unfamiliar environment ^ocationi md 
identification of specific features under varying lighting and onentotiov ^ It may also > pe 
with partially obscured objects. This level of vision system capability may not be available 
off-the-shelf and could require a sizable development cost. 


2. Guiding a robot (path planning and collision avoidance)-Along with the capabilities outlined 
above, vision system capabilities include use of its images to generate amapof its 
surroundings. 3D image generation may require a stereo vision system. Trajectory 
determination for the robot movement uses this map. This becomes nwrecomphcated when 
the vision system operates in hostile outdoor terrain. Development of this capability for an 
operational system will be costly and will require large R&D investment. 

5 — Laser system 

Typical laser usage includes being a range finder or scanner. Many applications hav^roven 
them accurate and reliable. However, if it is a high power laser beam, it could be ^nfu 1 
Li may require an expensive and elaborate set of safe guards. Part of the laser system cost 

includes the safe guards. 

6 — Others 

There are many other criteria for consideration in cost estimating the end effectors/special 

end effector's peculiarities. For example, an end effector posmons 
an X-ray imaging device. Unique issues require separate consideration. 
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Hardware I ' Capability I Complexity 


System 


Range 


Manipulator Systems 
Degree of Freedom (DOF) 
DOF<=6 
DOF >6 
Others 

Reach (FT) (R) 

10>R 

l(kR<50 

Others 

Payload Capability (lb) (PC) ' 
1 10>PC 

l(kPC<25 
25<PC<100 
Others 

Positioning Accuracy (in) (PA) 
0.1 <P A 
0j 001<PA<0.1 
Others 

Command & Control (CO 
HD/ 

Conventional 

Modern 

Control 

Integrated 

Advanced 

Sensors 

Others 


Level (CL) 


(L,M,H) 


(L,M,H) 


(L,M,H) 


(L,M,H) 


Technology 

Readiness 

(TL) 


Parameter 
Cost ($K) 
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Hardware 

System 


Capability 

Complexity 

Technology 

KSC Robot CL 

Range 

Level (CL) 

Readiness 

(TL) 

\ 



Parameter 
Cost ($K) 


Handling 

Contact Tool (L,M,H) 

Non-contact/ 

Inspection 
Others 

Environment (T oxid ty) 

None (L,M,H) 

Toxic 

Force/torque & Micro-positioning Control 


None 
Low/Medium 
Resolution 
High 

Resolution 


(L,M,H) 


Machine Vision 


Laser System 


None 

Low/Medium 

Resolution 

High 

Resolution 

None 
Low Power 
(safe) 

High Power 
(unsafe) 


(L,M # H) 


(L,M,H) 


5 

5 


6 

5 

6 

5 

6 
6 


700 


H 


H 


M 
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Additional Data Points 

The cost data are from off-the-shelf hardware that could be used for model construction. 


Hardware 

Capability 

Complexity 

Technology 

KSC Robot CL 

System 

Range 

Level (CL) 

Readiness 

(TL) 



Parameter 
Cost ($K) 


Mobile Base/Platform 
Payload Capability (lb) (PL) 

PL>250 (L,M,H) 

250<PL<1000 
1000<PL<10000 
KXXXkPL 
Others 

Positioning Accuracy (IN) (PA) 

PA>1.0 (L,M,H) 

1.0>PA>0.1 
0.1 >PA 
Others 

Control & Navigation (CN) 

Remote control (L,M,H) 

Self-guided 
(AGV type) 

Path planning 
capability 
Others 


6 

6 

6 

6 


6 

6 

6 


40-100 


M 


M 


Off-the-shelf AGV 
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Hardware 

System 

Capability 

Range 

Complexity 
Level (CL) 

Technology 

Readiness 

(TL) 

KSC Robot CL 

Parameter 
Cost ($K) 

Manipulator 

Systems 




60-120 

1 Degree of Freedom (DOF) 





DOF<=6 

(L,M,H) 

6 

M 


DOF>6 


6 



Others 


— 


Reach (FT) (R) 





10>R 

(L,M,H) 

6 

L 


10<R<50 


6 



Others 


— 


I Payload Capability (lb) (PC) 





10>PC 

(L,M,H) 

6 



10<PC<25 


6 

M 


25<PC<100 


6 



Others 


— 


1 Positioning Accuracy (in) (PA) 





0.1 <PA 

N/A 

6 



OJ001<PA<0.1 


6 

X 


Others 


— 


1 Command Sc Control (CC) 





PID/ 

(L,M,H) 

6 

M 


Conventional 





Modern 


6 



Control 





Integrated 


4 



Advanced 





Sensors 





Others 


— 



Off-the-shelf manipulator arm 
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Hardware 

System 

Capability 

Range 

Complexity 
Level (CL) 

Technology 

Readiness 

(TL) 

KSC Robot CL 

Parameter 
Cost ($K) 

1 Special Tools (Parallel Jaw) 




5-15 

Handling 






Contact Tool 

(L,M,H) 

5 

L 


Non-contact/ 


5 



Inspection 





Others 


— 


1 Environment (Toxidty) 




i 

None 

(L,M,H) 

— 

1 


Toxic 


— 


1 Force/torque tc Micro-positioning Control 




None 

<L,M,H> 

— 

— 


Low/Medium 


6 



Resolution 





High 


5 



Resolution 




I Machine Vision 





None 


— 

— 


Low/Medium 

(L,M,H) 

6 



Resolution 





High 


5 



Resolution 




Laser System 






None 


— 

— 


LowFowa 

(L,M,H) 

6 



(safe) 





High Power 


6 



(unsafe) 





Off-the-shelf parallel jaw 
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Hardware 

Capability 

Complexity 

Technology 

KSC Robot CL 

Parameter 

System 

r- « i pt * i _ 

Range 

. t i! . . n « 

Level (CL) 

Readiness 

<TL> 


Cost ($K) 


(L,M,H) 


Handling 

Contact Tool 
Non-contact/ 

Inspection 

Others 

Environment (EMI, Temperature) 

None <L,M,H) 

EMI (LXH) 

Temperature (L,M,H) 

Force/torque & Micro-positioning Control 
None (L,M,H) 

Low/Medium 
Resolution 
High 

Resolution 


Machine Vision 


Laser System 


None 

Low/Medium 

Resolution 

High 

Resolution 

None 
Low Rower 
(safe) 

High Power 
(unsafe) 


(L,M,H) 


(L,M,H) 


5 

5 


6 

6 


6 

5 

6 

5 

6 
6 


25-50 


M 


M 

M 


Off-the-shelf welding end effector 
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